-- Logs begin at Thu 2022-08-25 01:51:06 UTC, end at Thu 2022-08-25 03:17:16 UTC. -- Aug 25 02:46:23.018045 dv-cinder-779578-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Aug 25 02:46:23.025951 dv-cinder-779578-6-smb devstack@keystone.service[81617]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Aug 25 02:46:23 2022] *** Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: nodename: dv-cinder-779578-6-smb Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: machine: x86_64 Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: clock source: unix Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: pcre jit disabled Aug 25 02:46:23.028003 dv-cinder-779578-6-smb devstack@keystone.service[81617]: detected number of CPU cores: 4 Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: current working directory: / Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: detected binary path: /usr/bin/uwsgi-core Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: your processes number limit is 47680 Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: your memory page size is 4096 bytes Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: detected max file descriptor number: 2048 Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: lock engine: pthread robust mutexes Aug 25 02:46:23.028446 dv-cinder-779578-6-smb devstack@keystone.service[81617]: thunder lock: enabled Aug 25 02:46:23.028771 dv-cinder-779578-6-smb devstack@keystone.service[81617]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 25 02:46:23.028771 dv-cinder-779578-6-smb devstack@keystone.service[81617]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 25 02:46:23.068174 dv-cinder-779578-6-smb devstack@keystone.service[81617]: Python main interpreter initialized at 0x557aeed3a9c0 Aug 25 02:46:23.068174 dv-cinder-779578-6-smb devstack@keystone.service[81617]: python threads support enabled Aug 25 02:46:23.068174 dv-cinder-779578-6-smb devstack@keystone.service[81617]: your server socket listen backlog is limited to 100 connections Aug 25 02:46:23.068174 dv-cinder-779578-6-smb devstack@keystone.service[81617]: your mercy for graceful operations on workers is 90 seconds Aug 25 02:46:23.068574 dv-cinder-779578-6-smb devstack@keystone.service[81617]: mapped 403077 bytes (393 KB) for 2 cores Aug 25 02:46:23.068650 dv-cinder-779578-6-smb devstack@keystone.service[81617]: *** Operational MODE: preforking *** Aug 25 02:46:23.068927 dv-cinder-779578-6-smb devstack@keystone.service[81617]: *** uWSGI is running in multiple interpreter mode *** Aug 25 02:46:23.068927 dv-cinder-779578-6-smb devstack@keystone.service[81617]: spawned uWSGI master process (pid: 81617) Aug 25 02:46:23.069144 dv-cinder-779578-6-smb systemd[1]: Started Devstack devstack@keystone.service. Aug 25 02:46:23.077178 dv-cinder-779578-6-smb devstack@keystone.service[81617]: spawned uWSGI worker 1 (pid: 81632, cores: 1) Aug 25 02:46:23.077178 dv-cinder-779578-6-smb devstack@keystone.service[81617]: spawned uWSGI worker 2 (pid: 81633, cores: 1) Aug 25 02:46:23.077178 dv-cinder-779578-6-smb devstack@keystone.service[81617]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 25 02:46:27.370600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:46:27.370600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: from cryptography.utils import int_from_bytes Aug 25 02:46:27.371371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:46:27.371371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: from cryptography.utils import int_from_bytes Aug 25 02:46:27.371490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:46:27.371490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Aug 25 02:46:27.371895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 25 02:46:27.371895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: from cryptography.utils import int_from_bytes Aug 25 02:46:27.421785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:46:27.421969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:46:27.422141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] command line args: [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:46:27.422408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:46:27.422584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ================================================================================ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:46:27.422662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 25 02:46:27.422841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] admin_token = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.422926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 25 02:46:27.423089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_dir = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.423167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] command line args: [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 25 02:46:27.423276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.423391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 25 02:46:27.423477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] config_source = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.423580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ================================================================================ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 25 02:46:27.423663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] debug = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.423806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_dir = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] config_source = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] debug = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_config_append = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.425925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_dir = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_config_append = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_dir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.426916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.427923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.428094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.428182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.428332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.428537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.428723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.428901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.429083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.429228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.429228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.429432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.429540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.429540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.430267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.430267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] publish_errors = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.430443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.430555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.430638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.430776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.72/identity {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] publish_errors = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.431877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] standard_threads = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] standard_threads = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_journal = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.432925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_json = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_stderr = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] use_syslog = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_journal = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_json = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.433803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_stderr = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] use_syslog = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.433985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 25 02:46:27.434232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.434974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.435979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.436923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.437899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.438852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.439980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.440952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.441966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.442910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.443985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.444946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.445030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.445178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.445261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.445990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.446975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.447875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.448895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.449985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.450900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.451928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.452978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.453898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.454930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.455970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.456882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.457930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.458977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.external = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.459927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.external = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.password = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.460915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] auth.token = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.password = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] auth.token = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.461959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.462887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.463940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.464995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.465930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.466981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.467908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.468998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.469998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.470931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.471854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.472956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.473996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.474919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.475892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.476970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.477809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.478964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.479894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.480948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.481996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.482924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.483962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.484922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.485961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.486959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.487882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.488966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.489892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.490900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.491920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.492034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.492170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.492826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.493945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.494983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.495919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.496999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.497961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.498886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.499932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.500989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.501912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.502958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.503880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.504912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.505887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.506950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.507741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.508502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.508635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.508765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.508885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81633) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:46:27.509799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.509799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.510014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.510137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.510322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.510565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.510819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.511062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.511312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.511548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.511793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.512034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 25 02:46:27.512228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 25 02:46:27.538894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.539144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.539370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.541527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.541766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.541997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.547942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.550461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.577347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.577572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.577981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.578219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.630748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.631398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.680644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.680867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.682170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.682410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.839923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.840074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.840160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.840289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.840374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.840504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.863839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.864937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.865029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.865143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.865223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.865361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.865575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.865789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.877106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.877431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.890965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.891092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.891176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.891300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81633) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.891382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.891540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.891756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 25 02:46:27.908196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.908407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:46:27.908748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.908830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.908949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:46:27.909046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:46:27.909222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.909326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.909486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.909566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 25 02:46:27.909744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.909825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.910046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.910245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.910325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.910811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.920142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.920414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.920685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.920969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.921051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.921308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.921585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.921873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.927889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.928977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.931453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.931734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.932018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.932328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.932457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.932611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.932743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.932873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.933892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.934060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.934178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.934334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.934443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.934769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.935053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.935328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.956804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.958126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.958242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.958527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.959609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.959960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.963296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.963581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.963867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.964961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.965254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.965543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.970179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.970465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.971901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.972216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.974519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.974812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.975095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.975378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.975671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.975933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.976233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.976338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:27.976508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.977160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.977641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.977938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.978221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.978500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.978773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.979044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.994931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.995217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.997016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.997305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:27.999088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.001201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.002309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.002605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.004446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.004750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.006788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.008984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.009934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.012124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.013242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.013544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.013826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.014118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.014396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.014688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.015366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.015673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.015965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.016292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.016575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.016874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.030774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.031071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.031348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.031611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.033242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.033545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.033819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.034098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.038431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.040696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.040974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.041557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.043106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.043390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.043580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.043866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.044187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.044481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.044763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.046065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.046355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.046661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.046951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.047253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.056739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.057027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.057310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.057594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.057875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.058152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.058429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.059214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.059503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.059793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.060101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.060427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.060731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.061033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.073922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.076486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.076962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.079492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.079803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.081314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.082366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.082771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.083063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.083346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.083796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.085310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.085608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.085897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.089902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.091345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.092540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.093992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.094247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.094537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.094822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.095102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.096927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.097234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.097527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.097820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.103535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.103828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.104131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.106572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.106878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.107166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.110954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81633) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.111240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.111531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.111809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.112102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.112394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.112670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.112946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.113224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.113497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.113768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.114031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.114112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 25 02:46:28.114302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.114392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.114561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81633) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.114645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.114869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.115158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.115436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.115715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.116005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.116305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.116594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.116871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.117149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.118201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.118566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 25 02:46:28.149746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557aeed3a9c0 pid: 81633 (default app) Aug 25 02:46:28.153126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af3dc0-67db-4a47-8602-7d6468a1d7e0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:28.153414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af3dc0-67db-4a47-8602-7d6468a1d7e0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:28.153685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af3dc0-67db-4a47-8602-7d6468a1d7e0 None None] PATH_INFO: `/v3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:28.153783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557aeed3a9c0 pid: 81632 (default app) Aug 25 02:46:28.157885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1/1] 10.222.0.72 () {50 vars in 791 bytes} [Thu Aug 25 02:46:28 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:34.701652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:34.702250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:34.702250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:34.706491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1/2] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:34 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:34.711730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:34.712188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:34.712313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:34.783617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: INFO dbcounter [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] Registered counter for database keystone Aug 25 02:46:34.802858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG oslo_db.sqlalchemy.engines [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81633) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:46:34.809184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writer thread running {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:46:34.988773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG passlib.handlers.bcrypt [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81633) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 02:46:34.989131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG passlib.handlers.bcrypt [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81633) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 02:46:35.043855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:35.045482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:35.171830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 2/3] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:34 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 461 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 02:46:35.641894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:35.711284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: INFO dbcounter [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] Registered counter for database keystone Aug 25 02:46:35.732448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG oslo_db.sqlalchemy.engines [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 25 02:46:35.738511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writer thread running {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 25 02:46:35.856535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dadaf9-35cd-420a-bd7e-1b24fcf09ac9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:35.860777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:35.861396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:35.861672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:35.861942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:35.870448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:35.921708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 02:46:35.921991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15da1b9-eb40-4e6e-a6b5-ae75560d7a06 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:35.931918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 2/4] 10.222.0.72 () {58 vars in 1324 bytes} [Thu Aug 25 02:46:35 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 02:46:35.938017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:35.952937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee160bc-29ff-4822-8471-9998d01b93c7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:35.957291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:35.958401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:35.958684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:35.958957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] PATH_INFO: `/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:35.960533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] RBAC: Authorizing `identity:get_project(project_id=35c83d4ef30f4517a1cc1f145e8660eb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:36.012934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING keystone.common.rbac_enforcer.enforcer [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 25 02:46:36.013279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63708437-7651-403f-a7fd-f7af0ae0b64f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:36.017779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 3/5] 10.222.0.72 () {56 vars in 1207 bytes} [Thu Aug 25 02:46:35 2022] GET /identity/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:37.904647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1ca9-3bbf-4b32-afb5-14bff6f43050 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.905180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1ca9-3bbf-4b32-afb5-14bff6f43050 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.905180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3c1ca9-3bbf-4b32-afb5-14bff6f43050 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.909328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 3/6] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:37 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:46:37.915340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:37.915767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:37.915896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:37.936725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:37.938713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:37.946826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 4/7] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:37 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 25 02:46:38.213734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c1ca9-3bbf-4b32-afb5-14bff6f43050 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.225663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3c1ca9-3bbf-4b32-afb5-14bff6f43050 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.230520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564a3d1f-e003-4f3a-abc8-2b4841d1b536 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.231111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3d1f-e003-4f3a-abc8-2b4841d1b536 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.231391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3d1f-e003-4f3a-abc8-2b4841d1b536 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.231658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564a3d1f-e003-4f3a-abc8-2b4841d1b536 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.239425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a3d1f-e003-4f3a-abc8-2b4841d1b536 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.241661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564a3d1f-e003-4f3a-abc8-2b4841d1b536 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.250931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 4/8] 10.222.0.72 () {58 vars in 1324 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 02:46:38.256570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:38.266449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7237291-68e0-4557-9c67-76d468850b23 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:38.271079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7235cd8a-2fdd-4e7d-9b8c-ced5fe0b0015 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:38.271702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235cd8a-2fdd-4e7d-9b8c-ced5fe0b0015 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:38.271984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235cd8a-2fdd-4e7d-9b8c-ced5fe0b0015 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:38.272291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7235cd8a-2fdd-4e7d-9b8c-ced5fe0b0015 admin admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:38.274212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235cd8a-2fdd-4e7d-9b8c-ced5fe0b0015 admin admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:38.276020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7235cd8a-2fdd-4e7d-9b8c-ced5fe0b0015 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:38.277578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 5/9] 10.222.0.72 () {56 vars in 1198 bytes} [Thu Aug 25 02:46:38 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:40.220374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e06ba-a2e1-4cd6-a480-ec6362d1a3a0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.221352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e06ba-a2e1-4cd6-a480-ec6362d1a3a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.221821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1e06ba-a2e1-4cd6-a480-ec6362d1a3a0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.223669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 5/10] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:40.229288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.230060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.230441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.249301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:40.250773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:40.312712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c0131-d0cf-4548-80fb-84fb925a0306 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.313104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c0131-d0cf-4548-80fb-84fb925a0306 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.313448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592c0131-d0cf-4548-80fb-84fb925a0306 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.314833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 6/11] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:46:40.320686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.320888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.321117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.334877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 6/12] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:40.362894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81632) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 25 02:46:40.363317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG passlib.handlers.bcrypt [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81632) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 25 02:46:40.409451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:40.411024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:40.507643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 7/13] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:46:40.603343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:40.627254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:40.707114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c703ee6-d636-475c-b367-2df2208759b9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:40.739930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:40.740591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.740872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.741146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.752173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:40.761833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:40.762880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:46:40.763693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 7/14] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:40.768991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:40.782021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:40.866040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:40.873733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8a340-a60f-4fdd-af46-b27b04354b05 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:40.876035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:40.885456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6412690e-2393-4436-b78f-01c156d45f66 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:40.912381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:40.913236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.913514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.913863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.914617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:40.914917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:40.916369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:40.919103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:40.919708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:40.919985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:40.920289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:40.927832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 8/15] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:40.933839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:40.989168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:40.990705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.033623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a9c9d4-9705-46b9-ae6c-04f8965a0c30 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.066510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.067359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.067639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.067917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.069401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:41.071427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.071866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.073432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 9/16] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:40 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:41.079076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.090617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 8/17] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:46:41.096220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.112534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.178857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ed3172-3edc-4578-a6cf-637bdda603fd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.194053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6a43a2-c462-4b0f-8258-af8857a1ce35 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.213433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.214059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.214339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.214634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.215739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:41.217362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.218918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 10/18] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:41.224793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.234702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.235345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.235627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.235902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.246911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:41.248410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:41.265192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:41.266219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:41.267356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:41.267356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:41.267356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:46:41.267356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 9/19] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:41.272204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:41.308274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.328180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2989db-403a-4630-b739-b3c7c68acea0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.329672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:41.363825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.364459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.364743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.365013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.365728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.domain.id=default, user.id=188b360683ba4b74b4dc35f5cde2b951) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:41.366029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:41.368216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239b1b3e-15a9-4bf9-b725-0f3f3effcb43 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.374864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1f570-ee01-41c4-adf5-7bbc1105df50 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:41.376501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 11/20] 10.222.0.72 () {56 vars in 1322 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/role_assignments?user.id=188b360683ba4b74b4dc35f5cde2b951&scope.domain.id=default&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 233 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:41.413194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:41.413856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:41.414227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:41.414717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:41.415404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:41.415714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:41.417165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f47e0f-19c4-403b-a739-9af562f2a804 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:41.436811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 10/21] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:43.459021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e085d7-54be-46ba-b012-99bf70942b4c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.459527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e085d7-54be-46ba-b012-99bf70942b4c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.459631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e085d7-54be-46ba-b012-99bf70942b4c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.461110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 12/22] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:43.466546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12556-b604-4a5f-8de5-b0cb64f2dc11 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.467356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12556-b604-4a5f-8de5-b0cb64f2dc11 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.467823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f12556-b604-4a5f-8de5-b0cb64f2dc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.493529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f9f12556-b604-4a5f-8de5-b0cb64f2dc11 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:43.495049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f9f12556-b604-4a5f-8de5-b0cb64f2dc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:43.578253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 11/23] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:43.631745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9494c0-7fe1-41d6-94aa-1c11fb915ed0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.632478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9494c0-7fe1-41d6-94aa-1c11fb915ed0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.632977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9494c0-7fe1-41d6-94aa-1c11fb915ed0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.634736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 13/24] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:43.640392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b942e9-eb47-44ac-908b-00ca913c0e64 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:43.640905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b942e9-eb47-44ac-908b-00ca913c0e64 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:43.641372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b942e9-eb47-44ac-908b-00ca913c0e64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:43.665958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b3b942e9-eb47-44ac-908b-00ca913c0e64 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:43.667473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b3b942e9-eb47-44ac-908b-00ca913c0e64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:43.689125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:43.754731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 12/25] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:44.008474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9494c0-7fe1-41d6-94aa-1c11fb915ed0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:44.019936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b684-e0b3-406f-ac9f-a55e12f5f6ea None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.020455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b684-e0b3-406f-ac9f-a55e12f5f6ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.020899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4037b684-e0b3-406f-ac9f-a55e12f5f6ea None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.022651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 13/26] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:44.028734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.029199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.029638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.059625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:44.061095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:44.186031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9494c0-7fe1-41d6-94aa-1c11fb915ed0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:44.197743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 14/27] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:46:44.249921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332e73-703f-4a79-a954-0067214d019e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:44.250551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332e73-703f-4a79-a954-0067214d019e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.250825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332e73-703f-4a79-a954-0067214d019e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.251093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11332e73-703f-4a79-a954-0067214d019e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.268163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11332e73-703f-4a79-a954-0067214d019e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-11332e73-703f-4a79-a954-0067214d019e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:44.277757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:44.278578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:46:44.279328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 14/28] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:44.285296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:44.331102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332e73-703f-4a79-a954-0067214d019e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:44.392416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:44.449937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:44.474614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c68da4-2767-4860-9c5d-c082c8133a57 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:44.524848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:44.525384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.525662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.525930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.526600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:44.526900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:44.528316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:44.532126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11332e73-703f-4a79-a954-0067214d019e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:44.542452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 15/29] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:44.543129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:44.570941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:44.571906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.572427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.572892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.592613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:44.594220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a0a9d6ee-ca62-4c15-8e74-edf7502b35e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:46:44.612651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:44.613726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:46:44.614816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:46:44.614816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:46:44.614816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:46:44.615868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 15/30] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:46:44.622618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a86a93-e969-4847-b1dc-2f98f754d04a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.623017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a86a93-e969-4847-b1dc-2f98f754d04a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.623397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a86a93-e969-4847-b1dc-2f98f754d04a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.625120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 16/31] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:44.625916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a86a93-e969-4847-b1dc-2f98f754d04a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:44.677166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62830ea-27ff-4832-8df4-1d59bfb39543 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:44.715249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6633dbd9-9868-4968-8d09-7611594fd000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:44.716001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dbd9-9868-4968-8d09-7611594fd000 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.716425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dbd9-9868-4968-8d09-7611594fd000 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.716795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6633dbd9-9868-4968-8d09-7611594fd000 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.717562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dbd9-9868-4968-8d09-7611594fd000 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:44.719150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6633dbd9-9868-4968-8d09-7611594fd000 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:44.731644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:44.756216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a86a93-e969-4847-b1dc-2f98f754d04a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:44.793770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:44.794316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.794594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.794866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.796285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:44.797868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:44.799705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 17/32] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:44 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:44.800266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:44.872541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 16/33] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Aug 25 02:46:44 2022] POST /identity/v3/roles => generated 219 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:44.874676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.875260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.875755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.901563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:44.912844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22866622-368d-49eb-b4ce-ee8c097b2ed6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:44.914957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:44.917839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:44.955996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:44.957118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:44.957593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:44.958056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:44.958905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:44.959412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:44.961685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:44.981646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 18/34] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:46:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:44.982961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:45.001805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:45.049378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 17/35] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:45.050302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:45.150517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3871624c-e495-4737-8253-93a5bb0701e1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:45.168886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55063806-7321-4eab-8c1e-f67bca8c7605 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:45.200490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da679d6a-0198-48b9-8420-40f39438dd9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:45.201136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da679d6a-0198-48b9-8420-40f39438dd9c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.201421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da679d6a-0198-48b9-8420-40f39438dd9c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.201696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da679d6a-0198-48b9-8420-40f39438dd9c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.203446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da679d6a-0198-48b9-8420-40f39438dd9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:45.205390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da679d6a-0198-48b9-8420-40f39438dd9c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:45.207458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 19/36] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:45.208427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2fc36-4a33-4e1b-90cd-dea66cf0a834 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.208763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2fc36-4a33-4e1b-90cd-dea66cf0a834 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.209042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c2fc36-4a33-4e1b-90cd-dea66cf0a834 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.213738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 20/37] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:45.216356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baccd32e-9fea-4487-8f07-2aebe9c789ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:45.216970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2fc36-4a33-4e1b-90cd-dea66cf0a834 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:45.217449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd32e-9fea-4487-8f07-2aebe9c789ff None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.217919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd32e-9fea-4487-8f07-2aebe9c789ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.218380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baccd32e-9fea-4487-8f07-2aebe9c789ff None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.219216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccd32e-9fea-4487-8f07-2aebe9c789ff None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:45.221069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baccd32e-9fea-4487-8f07-2aebe9c789ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:45.240525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:45.266109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 18/38] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:46:45 2022] POST /identity/v3/projects => generated 301 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:45.267961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.268923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.269282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.291965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:45.293618 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:45.332556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:45.364470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c2fc36-4a33-4e1b-90cd-dea66cf0a834 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:45.407892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f942738f-02a5-410f-98ac-d8f06cc9b943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:45.408797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942738f-02a5-410f-98ac-d8f06cc9b943 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.409152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942738f-02a5-410f-98ac-d8f06cc9b943 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.409521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f942738f-02a5-410f-98ac-d8f06cc9b943 None admin] PATH_INFO: `/v3/domains/default/users/188b360683ba4b74b4dc35f5cde2b951/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.411883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942738f-02a5-410f-98ac-d8f06cc9b943 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=188b360683ba4b74b4dc35f5cde2b951, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:45.413426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f942738f-02a5-410f-98ac-d8f06cc9b943 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:45.513830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 19/39] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:45.515308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:45.549465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 21/40] 10.222.0.72 () {58 vars in 1361 bytes} [Thu Aug 25 02:46:45 2022] PUT /identity/v3/domains/default/users/188b360683ba4b74b4dc35f5cde2b951/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:46:45.636193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c35a0e-bd01-43c7-9932-ac358414c20e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:45.661040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5b5ec-2424-43a5-97d0-437226288c00 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.661388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5b5ec-2424-43a5-97d0-437226288c00 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.661727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d5b5ec-2424-43a5-97d0-437226288c00 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.663093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:45.667279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 22/41] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:45.676880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.677508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.677896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.692543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:45.693176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.693457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.693730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.694410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:45.696788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:45.708784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:45.709083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:45.725001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 20/42] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Aug 25 02:46:45 2022] POST /identity/v3/roles => generated 225 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:45.801638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 23/43] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:46:45.842582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:45.962156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088fe3d-69fe-4ac8-858f-23e5dfcfa984 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:45.997998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:45.998616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:45.998900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:45.999175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:45.999839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.001289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.020088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 21/44] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Aug 25 02:46:45 2022] POST /identity/v3/roles => generated 223 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:46.087841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.158957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.204267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca45a4ee-7826-4451-b912-7dd2ad400962 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.240708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2a9dd2-6443-4227-a566-ab4a908161fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.241343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9dd2-6443-4227-a566-ab4a908161fe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.241657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9dd2-6443-4227-a566-ab4a908161fe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.241930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2a9dd2-6443-4227-a566-ab4a908161fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.243039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9dd2-6443-4227-a566-ab4a908161fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.244659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2a9dd2-6443-4227-a566-ab4a908161fe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.246239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 24/45] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:46.251890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:46.292893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:46.354668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14669e57-3250-4db0-87f5-4bc695c7f12e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:46.387040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdb236e-672c-4cc2-982d-8e7c7d6b1d49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:46.387648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb236e-672c-4cc2-982d-8e7c7d6b1d49 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:46.387933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb236e-672c-4cc2-982d-8e7c7d6b1d49 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:46.388243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdb236e-672c-4cc2-982d-8e7c7d6b1d49 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:46.388899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb236e-672c-4cc2-982d-8e7c7d6b1d49 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:46.390353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdb236e-672c-4cc2-982d-8e7c7d6b1d49 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:46.417760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 22/46] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:46:46 2022] POST /identity/v3/projects => generated 312 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:46:47.605382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1e72c-6e0d-4d1a-8e06-1da034c76c5f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.605894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1e72c-6e0d-4d1a-8e06-1da034c76c5f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.605978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef1e72c-6e0d-4d1a-8e06-1da034c76c5f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.607275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 25/47] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:47.612620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:47.612991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:47.613335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:47.631881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:47.633348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:47.699217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 23/48] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:47.965378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1e72c-6e0d-4d1a-8e06-1da034c76c5f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.064914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef1e72c-6e0d-4d1a-8e06-1da034c76c5f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:48.094172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:48.099379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:48.100016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.100331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.100629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.110716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:48.115563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:48.116474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:46:48.117525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 26/49] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:48.122613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.145346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:48.225570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8726dd9-50e8-4c44-bedf-7c6a5c4a84be None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:48.259882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:48.260519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.260800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.261070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.261736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:48.262034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:48.263417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87da228c-db83-4972-9f30-aec78c33e5c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:48.271539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 24/50] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:48.277711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.348234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e00c2-c139-45bc-b55b-89d2f8172a33 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.348524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e00c2-c139-45bc-b55b-89d2f8172a33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.348803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0e00c2-c139-45bc-b55b-89d2f8172a33 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.350171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 25/51] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:46:48.356300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.356590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.356868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.376448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:48.377674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:48.449293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 26/52] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:46:48.483554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76f0bb2-662b-42ce-aa86-46ec3c4fb9de None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:48.515741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:48.516394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.516673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.516944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.518049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:48.519741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:48.521344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 27/53] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:48 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:48.527409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.542111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:48.625346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f96da-4ed1-4202-8596-df3775a93733 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:48.658966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:48.659600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.659885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.660207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.661384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:48.662832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:48.665016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 27/54] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:48.670776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.718623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.730252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:48.772418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b2a0f7-c7cf-4707-9de6-1fd6c07d893d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:48.800686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:48.808296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:48.808900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.809180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.809455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.810181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.domain.id=default, user.id=188b360683ba4b74b4dc35f5cde2b951) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:48.810486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:48.811934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:48.817571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 28/55] 10.222.0.72 () {56 vars in 1322 bytes} [Thu Aug 25 02:46:48 2022] GET /identity/v3/role_assignments?user.id=188b360683ba4b74b4dc35f5cde2b951&scope.domain.id=default&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:48.821626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451a40c3-dca7-4201-9d16-caf9522cbb1b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:48.860465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d318cc62-ed88-41fc-a522-1cd4dcea5aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:48.861120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318cc62-ed88-41fc-a522-1cd4dcea5aa0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:48.861406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318cc62-ed88-41fc-a522-1cd4dcea5aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:48.861684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d318cc62-ed88-41fc-a522-1cd4dcea5aa0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:48.862893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318cc62-ed88-41fc-a522-1cd4dcea5aa0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:48.864436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d318cc62-ed88-41fc-a522-1cd4dcea5aa0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:48.866133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 28/56] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:48.872998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:48.988418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79bf0942-a238-40b0-bab4-9de85dd2fba6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:49.012137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:49.024790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f74718-b2b7-425e-adbb-9bef8c2e7b64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:49.025334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74718-b2b7-425e-adbb-9bef8c2e7b64 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:49.025614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74718-b2b7-425e-adbb-9bef8c2e7b64 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:49.025904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f74718-b2b7-425e-adbb-9bef8c2e7b64 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:49.026556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f74718-b2b7-425e-adbb-9bef8c2e7b64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:49.028007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f74718-b2b7-425e-adbb-9bef8c2e7b64 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:49.055542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 29/57] 10.222.0.72 () {60 vars in 1140 bytes} [Thu Aug 25 02:46:48 2022] POST /identity/v3/projects => generated 298 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:50.945803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7c65d-68fc-4e2c-a830-13d993eade1a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.946213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7c65d-68fc-4e2c-a830-13d993eade1a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.946361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf7c65d-68fc-4e2c-a830-13d993eade1a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.947900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 29/58] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:50.952921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:50.953295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:50.953487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:50.972509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:50.973707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:51.038803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 30/59] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:51.310102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7c65d-68fc-4e2c-a830-13d993eade1a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.411092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf7c65d-68fc-4e2c-a830-13d993eade1a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.443506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5972b6ba-a9b2-494a-8212-2961b6544a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.444156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b6ba-a9b2-494a-8212-2961b6544a6f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.444439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b6ba-a9b2-494a-8212-2961b6544a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.445273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5972b6ba-a9b2-494a-8212-2961b6544a6f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.446556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b6ba-a9b2-494a-8212-2961b6544a6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.447994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5972b6ba-a9b2-494a-8212-2961b6544a6f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.449574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 30/60] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:51.455159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:51.549705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7fc521-b972-46ae-98eb-ffe59e4dff1c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:51.557291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:51.584206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309d3245-2a24-48a8-82be-c9e2e18c348d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:51.584809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3245-2a24-48a8-82be-c9e2e18c348d None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:51.585090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3245-2a24-48a8-82be-c9e2e18c348d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:51.585367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309d3245-2a24-48a8-82be-c9e2e18c348d None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:51.586020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d3245-2a24-48a8-82be-c9e2e18c348d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:51.587456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309d3245-2a24-48a8-82be-c9e2e18c348d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:51.612484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 31/61] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:46:51 2022] POST /identity/v3/users => generated 275 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:46:54.431053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c021be-c231-4317-a1e2-4de4ac0f1107 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.431561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c021be-c231-4317-a1e2-4de4ac0f1107 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.431634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c021be-c231-4317-a1e2-4de4ac0f1107 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.432984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 31/62] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:54.449933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413872-b7e8-46cb-98e7-e7ec31446a33 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.450876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413872-b7e8-46cb-98e7-e7ec31446a33 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.451349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05413872-b7e8-46cb-98e7-e7ec31446a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.481313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05413872-b7e8-46cb-98e7-e7ec31446a33 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:54.482900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05413872-b7e8-46cb-98e7-e7ec31446a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:54.567596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 32/63] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:54.736265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968557b-e267-4dcc-b597-247dfe0ac20a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.736885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968557b-e267-4dcc-b597-247dfe0ac20a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.737405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5968557b-e267-4dcc-b597-247dfe0ac20a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.738954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 32/64] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:54.752345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dce29-7d15-4f52-90ef-83bc00003fc5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.753081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dce29-7d15-4f52-90ef-83bc00003fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.753580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010dce29-7d15-4f52-90ef-83bc00003fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.785061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-010dce29-7d15-4f52-90ef-83bc00003fc5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:54.786611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-010dce29-7d15-4f52-90ef-83bc00003fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:54.862876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 33/65] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:54.883255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f98b8-05ef-4948-97c6-debff6cb9dc5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.883868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f98b8-05ef-4948-97c6-debff6cb9dc5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.884373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f98b8-05ef-4948-97c6-debff6cb9dc5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.885931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 33/66] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:54.891541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:54.891833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:54.892137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:54.921032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:54.922222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:54.955378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:54.974102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f98b8-05ef-4948-97c6-debff6cb9dc5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:54.995746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.063450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 34/67] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:55.109778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f98b8-05ef-4948-97c6-debff6cb9dc5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.164156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc15ae5-ddd6-4353-a772-35a8f10c2cf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.165181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15ae5-ddd6-4353-a772-35a8f10c2cf6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.165692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15ae5-ddd6-4353-a772-35a8f10c2cf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.166172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc15ae5-ddd6-4353-a772-35a8f10c2cf6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.184200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc15ae5-ddd6-4353-a772-35a8f10c2cf6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4bc15ae5-ddd6-4353-a772-35a8f10c2cf6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:55.189356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:55.190247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:46:55.190982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:46:55.193222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 34/68] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:55.199870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.277615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197709a-0450-403a-bd2d-ce3695a343d6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.278213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197709a-0450-403a-bd2d-ce3695a343d6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.278760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d197709a-0450-403a-bd2d-ce3695a343d6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.280930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 35/69] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:46:55.281828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197709a-0450-403a-bd2d-ce3695a343d6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.347862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824294cf-380e-4eb9-a231-49d506f352ad None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.380879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.387029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.387645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.387932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.388240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.388920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:55.389225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:55.390619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b30192-a684-46e2-8499-d3a6d1c97acd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:55.400722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 35/70] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:55.401750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23227feb-47b9-4f52-888f-53361195d926 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.402045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23227feb-47b9-4f52-888f-53361195d926 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.402327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23227feb-47b9-4f52-888f-53361195d926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.414928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d197709a-0450-403a-bd2d-ce3695a343d6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.420763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-23227feb-47b9-4f52-888f-53361195d926 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:55.421957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-23227feb-47b9-4f52-888f-53361195d926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:55.431798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.461465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319744-55be-416b-a928-996668b48b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.462659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319744-55be-416b-a928-996668b48b1b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.463090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319744-55be-416b-a928-996668b48b1b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.463509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e319744-55be-416b-a928-996668b48b1b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.475194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e319744-55be-416b-a928-996668b48b1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5e319744-55be-416b-a928-996668b48b1b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:55.480932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:55.481782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:46:55.482522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 36/71] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:55.487502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319744-55be-416b-a928-996668b48b1b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.494245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 36/72] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:55.495085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23227feb-47b9-4f52-888f-53361195d926 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.594875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e319744-55be-416b-a928-996668b48b1b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.598182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23227feb-47b9-4f52-888f-53361195d926 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.629939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.630533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.630814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.631087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.633556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6678e4e-4a90-4919-884f-d59946d499c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.634189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678e4e-4a90-4919-884f-d59946d499c1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.634474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678e4e-4a90-4919-884f-d59946d499c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.634748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6678e4e-4a90-4919-884f-d59946d499c1 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.634873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.643639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:55.648902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:55.649730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 37/73] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:55.652786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.654854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6678e4e-4a90-4919-884f-d59946d499c1 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:55.656508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6678e4e-4a90-4919-884f-d59946d499c1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:55.658185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 37/74] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:55.659350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185e2e-aa6f-4f5e-9e82-8127b01356f3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.659632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185e2e-aa6f-4f5e-9e82-8127b01356f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.659907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e185e2e-aa6f-4f5e-9e82-8127b01356f3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.661140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 38/75] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:55.661919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185e2e-aa6f-4f5e-9e82-8127b01356f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.666664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.770490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e185e2e-aa6f-4f5e-9e82-8127b01356f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.771175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff617d0c-3b89-432a-a506-0f68243e8314 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.804727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.805337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.805622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.805707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.805896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.806309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.806563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:55.806647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.806858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.806940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:55.807523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:55.807826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:55.808318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:55.809262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86139d0f-d4cc-49ff-baaa-abd86215d411 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:55.816326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 39/76] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:55.821595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 38/77] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:55.821595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.821595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.821595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:55.822047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.836679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:55.837889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:55.886462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.890498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:55.905646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 39/78] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:46:55.906474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:55.930237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344f208e-6c1b-4a4c-8f07-8bff4bed0322 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:55.974785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:55.975400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:55.976267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:55.976606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.015869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a4c092-2e51-4748-958b-9c1c2da4303e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.047472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.048988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.054905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.055864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.056349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.056921 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.068304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:46:56.073502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:46:56.074337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:46:56.075096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 40/79] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:46:56.075718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.116668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.128879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.158500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 40/80] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:46:56.159285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.188139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c9a5aa-0efc-4b8f-af33-fd5c06502a21 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.222415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.223042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.223325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.223600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.224785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.226926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.228547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 41/81] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.229314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.260303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982b823e-1f3d-4920-bff0-d3deb7bf762d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.294259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.294889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.295177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.295455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.296601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.298081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.299715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 41/82] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.304770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.326541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd69d3-f132-4ae4-8ce2-bd9363884ec4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.331606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.343653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.361472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.362093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.362377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.362658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.363335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:56.363643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.365060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.373145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 42/83] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.374091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.402338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ae3095-ab51-4e1c-9a9e-5ec7f2a48722 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.435682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.436275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.436565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.436842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.437977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.439443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.441117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 42/84] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.441885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.476953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b65b6d-8186-4914-834d-7cbd2c9e168c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.510183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.510814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.511097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.511376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.512522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.513984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.515555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 43/85] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.516344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.542471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.545594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e57ede-b464-4779-94af-f1f6452d2131 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.564713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.579292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.579903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.580229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.580505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.618495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36300d63-9ae8-49c4-a5d2-6c040595d70d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.650599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.652110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.652258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.652715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.652995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.653266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.719961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.721407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.747952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.752328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 43/86] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:46:56.753052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.768059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.825702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 44/87] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:46:56.826552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.851335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc76671-556a-422c-9015-95d2d0fb2c76 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.885814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.886437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.886726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.887003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.888141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.889582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.891145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 44/88] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.891882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.926389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6178e058-3c88-4104-95ee-5ea381356c65 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:56.962952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:56.963328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:56.963939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:56.964252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:56.964549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:56.965304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=424c0059899e44a9a6a3b85a4aeaedea) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:56.965572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:56.967028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:56.973726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 45/89] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/role_assignments?user.id=424c0059899e44a9a6a3b85a4aeaedea&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=bf081564133f4648af5314a7102589fb => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:56.974457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:56.990676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:57.003247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118ee80b-07a4-4ca4-8803-d652a9e50aa4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.047147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.047771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.048078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.048361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.049027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.050538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.074228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 45/90] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:46:56 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:46:57.074228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:57.109419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cf721-7980-4291-8c4f-b3eb4f4e12e7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.173989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.174682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.174971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.175250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.176517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.177986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.180631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 46/91] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:46:56 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:57.181451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:57.215501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385d9103-6255-40f3-94c6-4e78ad604a3d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.250702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:57.267410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.269060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.269060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.269060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.270518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.271935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.279307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 46/92] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:46:57 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:57.279307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:57.290422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:57.333711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae8064a-0b0e-48c4-824d-41bff79a65b2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.381213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.382183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.382473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.382752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.420475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a614380c-1497-427e-89a7-4f13882a0712 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.469987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.470851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.471132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.472006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.472967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] RBAC: Adding query filter params (role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=424c0059899e44a9a6a3b85a4aeaedea) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:57.473473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.473786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.474960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.475248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.482272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 47/93] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:57 2022] GET /identity/v3/role_assignments?user.id=424c0059899e44a9a6a3b85a4aeaedea&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:57.483151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:57.560025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:57.581837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:57.609613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 47/94] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:46:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:46:57.615291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:57.621346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94b84a3-8c1b-48bf-b71b-34198c3f6734 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.700200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.700837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.701119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.701399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.702140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=188b360683ba4b74b4dc35f5cde2b951) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:57.702451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.703935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.715616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 48/95] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:57 2022] GET /identity/v3/role_assignments?user.id=188b360683ba4b74b4dc35f5cde2b951&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:46:57.780249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3b9bd-7a2e-488f-813e-b3e2075c64ae None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:57.819146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9364b9b-9289-423a-a232-b3ffcaa1c265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:57.820340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364b9b-9289-423a-a232-b3ffcaa1c265 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:57.820659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364b9b-9289-423a-a232-b3ffcaa1c265 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:57.821057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9364b9b-9289-423a-a232-b3ffcaa1c265 None admin] PATH_INFO: `/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:57.822450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9364b9b-9289-423a-a232-b3ffcaa1c265 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a80a65bdda4591a1fb9b35dd08e0b0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:57.823962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9364b9b-9289-423a-a232-b3ffcaa1c265 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:57.825837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 48/96] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:46:57 2022] GET /identity/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0 => generated 312 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:57.832138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:46:58.013438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad6de0-44e3-4df7-9a6e-693a52fe5d7d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:46:58.035796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:46:58.052553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:46:58.053235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:58.053512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:58.054467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:58.055229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, scope.project.id=e4a80a65bdda4591a1fb9b35dd08e0b0, user.id=424c0059899e44a9a6a3b85a4aeaedea) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:46:58.055543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:46:58.057036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fcca23-7a20-48ef-bbe7-c1b205eb375a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:46:58.063601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 49/97] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:46:57 2022] GET /identity/v3/role_assignments?user.id=424c0059899e44a9a6a3b85a4aeaedea&scope.project.id=e4a80a65bdda4591a1fb9b35dd08e0b0&role.id=bf081564133f4648af5314a7102589fb => generated 259 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:46:59.387515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4d1a-6d4f-4ed3-8653-ddd4f149d04c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:59.388024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4d1a-6d4f-4ed3-8653-ddd4f149d04c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:59.388124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cd4d1a-6d4f-4ed3-8653-ddd4f149d04c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:59.389645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 49/98] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:46:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:46:59.394860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:46:59.395258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:46:59.395415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:46:59.420289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:46:59.421481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:46:59.510071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 50/99] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:46:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:00.056182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4d1a-6d4f-4ed3-8653-ddd4f149d04c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:00.121963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:00.200845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cd4d1a-6d4f-4ed3-8653-ddd4f149d04c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:00.241019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d552713-bafa-449a-9ee1-62d78235cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:00.242570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552713-bafa-449a-9ee1-62d78235cb0c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.242863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552713-bafa-449a-9ee1-62d78235cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.243143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d552713-bafa-449a-9ee1-62d78235cb0c None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.261006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d552713-bafa-449a-9ee1-62d78235cb0c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8d552713-bafa-449a-9ee1-62d78235cb0c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:00.265778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:00.267391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:00.269192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 50/100] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:00.277252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:00.307925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0484da0-a48e-4c38-8fa3-a14a228fceab None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.308315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0484da0-a48e-4c38-8fa3-a14a228fceab None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.308574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0484da0-a48e-4c38-8fa3-a14a228fceab None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.310805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 51/101] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:00.316009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.316338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.316590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.349046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:00.351172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:00.478000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 52/102] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:00.528690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9dd3885-80a7-4e7f-b08e-c717e1d8c5f2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:00.570050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:00.612750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:00.613838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.614323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.614799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.615970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:00.617185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:00.619599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb34280-8ad4-4aac-a8f3-c86f4001219f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:00.640344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 51/103] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:00.645795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:00.701097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:00.784480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd587b5-805b-432d-914e-a11e78119cfc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:00.800608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abaa5-9438-4086-8aeb-fddea238adce None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.801472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abaa5-9438-4086-8aeb-fddea238adce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.802242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168abaa5-9438-4086-8aeb-fddea238adce None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.805545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 52/104] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:00.813785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.814578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.815318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.830217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:00.830864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:00.831242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:00.831534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:00.836738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:00.838217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:00.840360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 53/105] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:00 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:00.845773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:00.848371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:00.858509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:00.955645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff25b11-7493-43c2-ab18-ebfa01358439 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:00.958393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:00.999140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c546777b-8290-48fc-a8ce-654ce3154be5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.000157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546777b-8290-48fc-a8ce-654ce3154be5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.000586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546777b-8290-48fc-a8ce-654ce3154be5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.001009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c546777b-8290-48fc-a8ce-654ce3154be5 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.002311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546777b-8290-48fc-a8ce-654ce3154be5 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:01.002602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 53/106] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:01.006109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c546777b-8290-48fc-a8ce-654ce3154be5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:01.006109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 54/107] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:00 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:01.012380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f621-ddcf-4c22-8248-c26f434fb964 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.012685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f621-ddcf-4c22-8248-c26f434fb964 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.013024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15f621-ddcf-4c22-8248-c26f434fb964 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.014715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 55/108] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:01 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:01.019982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd72f33-f0ce-4cbe-87cb-391c7684d679 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.020311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd72f33-f0ce-4cbe-87cb-391c7684d679 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.020594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fd72f33-f0ce-4cbe-87cb-391c7684d679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.021365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.057406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7fd72f33-f0ce-4cbe-87cb-391c7684d679 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:01.058517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7fd72f33-f0ce-4cbe-87cb-391c7684d679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:01.151837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8506af-fc1a-4ca1-bfe5-e32bf1ea0ea1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.159505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:01.187935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8328f2b6-fd89-4755-9e2c-8c7f7aafd59c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.188888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328f2b6-fd89-4755-9e2c-8c7f7aafd59c None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.189316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328f2b6-fd89-4755-9e2c-8c7f7aafd59c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.189736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8328f2b6-fd89-4755-9e2c-8c7f7aafd59c None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22/users/424c0059899e44a9a6a3b85a4aeaedea/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.191898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328f2b6-fd89-4755-9e2c-8c7f7aafd59c None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd606b05c854710af4411dd179e8f22, user_id=424c0059899e44a9a6a3b85a4aeaedea, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:01.193640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8328f2b6-fd89-4755-9e2c-8c7f7aafd59c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:01.203728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 56/109] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:01.208109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dc626-4f40-44a4-aa0f-b2f617c7a572 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.208109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dc626-4f40-44a4-aa0f-b2f617c7a572 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.208109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975dc626-4f40-44a4-aa0f-b2f617c7a572 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.209340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 57/110] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:01 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:01.211109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dc626-4f40-44a4-aa0f-b2f617c7a572 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.221189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 54/111] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:01 2022] PUT /identity/v3/projects/9fd606b05c854710af4411dd179e8f22/users/424c0059899e44a9a6a3b85a4aeaedea/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:47:01.227209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1497b-2ad3-4fca-b47a-24f096143695 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.227767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1497b-2ad3-4fca-b47a-24f096143695 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.228260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1497b-2ad3-4fca-b47a-24f096143695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.271508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-44a1497b-2ad3-4fca-b47a-24f096143695 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:01.273876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-44a1497b-2ad3-4fca-b47a-24f096143695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:01.415512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 55/112] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:01.416909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e2e0-aafd-44ec-933b-c5e4b33dcff1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.417203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e2e0-aafd-44ec-933b-c5e4b33dcff1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.417484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1097e2e0-aafd-44ec-933b-c5e4b33dcff1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.418968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 56/113] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:01.424589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.424985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.425268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.426139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975dc626-4f40-44a4-aa0f-b2f617c7a572 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.427803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:01.448232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:01.449637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:01.468180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.469102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.469453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.469731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.481142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:01.485874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:01.486690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:01.487423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 58/114] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:01.488028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.545766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 57/115] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:01.546886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.604251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:01.626030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd81327-3384-4ca2-9865-05651ce18cca None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.662572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.663782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.664141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.664425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.675027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:01.681313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:01.682126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:01.682897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 59/116] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:01.683499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.711509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:01.747997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2263818f-ced2-47ca-8772-bd1e66e60d20 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.786010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.787019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.787316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.787653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.788930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:01.789238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:01.791220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:01.803044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 58/117] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:01.805000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f32ece4-4a46-4f86-94e5-577e41846d7a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.810141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.858938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.859574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.859853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.860153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.861432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:01.863682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:01.865309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 60/118] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:01.866099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:01.920562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:01.940257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c126d5-9518-423e-89b6-8aefb78b1ad3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.973325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:01.983572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:01.984213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:01.984498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:01.984774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:01.984866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9804f412-68c3-4467-a1e6-bcb4cbca2b7d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:01.985443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:01.985748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:01.987122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:01.996015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 59/119] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.001365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.021862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.023098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.023551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.023828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.025233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.026684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.032886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 61/120] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.032886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.111223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53cb799a-253e-40f8-a2ae-2343a312aeec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.135884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f69363-87e5-4bab-a63b-756002fa7ab0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.146476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.147113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.147963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.148282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.158342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:02.164225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:02.165053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:02.165969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 60/121] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:01 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:02.170686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.175543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.176353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.176775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.177211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.177994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.179868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.182524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.207734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 62/122] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:47:02 2022] POST /identity/v3/projects => generated 302 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:02.208875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.229060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.296344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e338ec-c3bd-437b-81ee-69a4626a34fc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.340813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.341522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.341837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.342080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.356358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded8682f-242f-4d96-ae37-579b76ad1564 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.357216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:02.363039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:02.364163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:02.365103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:02.367662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 61/123] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:02.368947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.405678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.406755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.407491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.408241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.409540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.412325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.414735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 63/124] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.415745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.461793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.504257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0d1094-9253-43c7-9b61-06e4d7676266 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.521352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.546188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d394d8-dd3e-4064-a3b0-fd124f13b196 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.559139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.559900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.560215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.560492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.562373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.564466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.566704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 62/125] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.567532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.591388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.592227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.592585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.592934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.593728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:02.594041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.595497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.605168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 64/126] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.610476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.706564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a365aae0-f27e-4f51-a802-6b20c7021203 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.723051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffedb775-c5e9-47a2-a8ad-4f3e7c07ef87 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.754300 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.754910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.755195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.755475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.756185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:02.756495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.758129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.763978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.769485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.770396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.770688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.770995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.773494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 63/127] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.773651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.775109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.775232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.776873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 65/128] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.781369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.794233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:02.897055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb68479-0ea3-4520-8619-bee21d63dd99 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.910799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10489b7b-3a9d-43c8-98ae-878272d0cafd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:02.945782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.947103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.947396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.947768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22/users/424c0059899e44a9a6a3b85a4aeaedea/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.950096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd606b05c854710af4411dd179e8f22, user_id=424c0059899e44a9a6a3b85a4aeaedea, role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.951915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.953693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:02.954341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:02.954631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:02.954913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] PATH_INFO: `/v3/users/c51b6ef2839044098242e3c370018bc9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:02.968964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 64/129] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:02 2022] PUT /identity/v3/projects/9fd606b05c854710af4411dd179e8f22/users/424c0059899e44a9a6a3b85a4aeaedea/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:02.972770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:02.986901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] RBAC: Authorizing `identity:get_user(user_id=c51b6ef2839044098242e3c370018bc9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:02.988369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:02.994796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 66/130] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/users/c51b6ef2839044098242e3c370018bc9 => generated 289 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:02.995748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:03.119309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.120068 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.168056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31733610-d100-45ff-b86c-69a3176c8493 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:03.184256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c526e9-197e-45df-834b-8a8b62dd4572 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:03.217878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:03.218545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.218824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.219100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22/users/188b360683ba4b74b4dc35f5cde2b951/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.221084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd606b05c854710af4411dd179e8f22, user_id=188b360683ba4b74b4dc35f5cde2b951, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:03.222557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:03.227211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:03.228288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.228581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.229003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.232398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:03.234075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:03.235878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 65/131] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:02 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:03.236645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:03.242002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 67/132] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:02 2022] PUT /identity/v3/projects/9fd606b05c854710af4411dd179e8f22/users/188b360683ba4b74b4dc35f5cde2b951/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:03.251091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:03.362412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133bc399-2425-44fd-aaec-805f2a759b47 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:03.393358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.396881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6727d7e-d71f-4dbe-8e80-adabd5fa0317 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:03.403607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:03.404316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.404606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.404886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.428568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.438261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:03.438901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.439184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.439455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] PATH_INFO: `/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.440694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] RBAC: Authorizing `identity:get_project(project_id=e4a80a65bdda4591a1fb9b35dd08e0b0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:03.442287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:03.443988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 68/133] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:03 2022] GET /identity/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0 => generated 312 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:03.452207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:03.483083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:03.484621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:03.565150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb02b212-5434-4195-b4f5-b288f3663af9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:03.598253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 66/134] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:03.605397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a07e0f-5c8b-4d01-90eb-c3d6bf639297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:03.606086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07e0f-5c8b-4d01-90eb-c3d6bf639297 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.606369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07e0f-5c8b-4d01-90eb-c3d6bf639297 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.606646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a07e0f-5c8b-4d01-90eb-c3d6bf639297 None admin] PATH_INFO: `/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0/users/424c0059899e44a9a6a3b85a4aeaedea/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.608594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a07e0f-5c8b-4d01-90eb-c3d6bf639297 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4a80a65bdda4591a1fb9b35dd08e0b0, user_id=424c0059899e44a9a6a3b85a4aeaedea, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:03.610038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a07e0f-5c8b-4d01-90eb-c3d6bf639297 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:03.612760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:03.624895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 69/135] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:03 2022] PUT /identity/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0/users/424c0059899e44a9a6a3b85a4aeaedea/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:03.648495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.690201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91592-b06f-4f41-8a78-5af03ec2174b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.690486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91592-b06f-4f41-8a78-5af03ec2174b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.690767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f91592-b06f-4f41-8a78-5af03ec2174b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.692259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 70/136] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:03.699121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.699556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.699839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.730646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c7a6b9-2de8-4803-bde7-b49482a23a1b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:03.736476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:03.737681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:03.777304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:03.777956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:03.778238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:03.778515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:03.780872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:03.782419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:03.793231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 67/137] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:03 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:03.794248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:03.846496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.883969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 71/138] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:03.962798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:03.968532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897480ed-06ee-4a00-a915-bd5b490c4d5b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:04.015706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:04.016463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:04.016745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:04.017024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:04.017817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] RBAC: Adding query filter params (role.id=1466a2f6e2bf420e8c38bd277bd60ec6, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=c51b6ef2839044098242e3c370018bc9) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:04.018378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:04.019806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:04.028160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 68/139] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:03 2022] GET /identity/v3/role_assignments?user.id=c51b6ef2839044098242e3c370018bc9&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=1466a2f6e2bf420e8c38bd277bd60ec6 => generated 259 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:04.212967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:04.344695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc40d58-31f0-4f4e-9b3a-c5011146c296 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:04.391460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:04.392122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:04.392407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:04.392680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:04.406132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:04.410905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:04.413606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:04.415471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 72/140] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:04.421341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:04.543087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe36ee6-40a9-46c4-a402-64b42a716eeb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:04.583543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:04.584198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:04.584484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:04.585358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:04.586176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:04.586485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:04.587873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:04.596719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 69/141] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:04.603400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:04.682281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:04.756349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365125e-ea28-44d4-813f-7f59a7342145 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:04.808088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17093c98-a1d5-45b9-b826-c9d7a025b00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:04.808651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17093c98-a1d5-45b9-b826-c9d7a025b00f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:04.808934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17093c98-a1d5-45b9-b826-c9d7a025b00f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:04.809212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17093c98-a1d5-45b9-b826-c9d7a025b00f None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:04.812721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17093c98-a1d5-45b9-b826-c9d7a025b00f None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:04.814187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17093c98-a1d5-45b9-b826-c9d7a025b00f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:04.816136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 73/142] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:04 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:04.822493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:04.858889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:04.963920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b33aa-2ad6-415a-98fa-e53234ee3e80 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:04.964266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b33aa-2ad6-415a-98fa-e53234ee3e80 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:04.964522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4b33aa-2ad6-415a-98fa-e53234ee3e80 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:04.966007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 74/143] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:04.969898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60aab70-d306-4457-899b-cd7f8329c475 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:04.975948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:04.977186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:04.977471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.014919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:05.016432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:05.053286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:05.054435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:05.054943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:05.055451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.154920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 75/144] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:05.199592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:05.201441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:05.241866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:05.342085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 70/145] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:05.347896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:05.432449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:05.514213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f174c3-fab0-492c-9484-71f09d6d8cbc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:05.562983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:05.563621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:05.563902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:05.564200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.567274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:05.568720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:05.570752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:05.573564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 76/146] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:05 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:05.579060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:05.755823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b043af-a484-439e-84eb-af6180a820e3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:05.784667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfbc6bf-4db4-4fb6-bd7d-c824bb6594e2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:05.788479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:05.839593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:05.842537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:05.843288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:05.843566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:05.843842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.844605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=424c0059899e44a9a6a3b85a4aeaedea) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:05.846598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:05.846598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979cfb97-9af7-4b22-ab25-4648246dcc51 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:05.862675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:05.863309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:05.863581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:05.863851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.864208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 77/147] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:05 2022] GET /identity/v3/role_assignments?user.id=424c0059899e44a9a6a3b85a4aeaedea&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=bf081564133f4648af5314a7102589fb => generated 608 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:05.865215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:05.866576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf33dfe-7ba0-44fc-bb70-7480051259ea None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:05.867084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf33dfe-7ba0-44fc-bb70-7480051259ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:05.867332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:05.867777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf33dfe-7ba0-44fc-bb70-7480051259ea None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.873422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 71/148] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:05.874416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 78/149] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:05 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:05.875330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:05.880776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:05.881399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:05.882084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:05.916963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:05.919007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:06.027637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e70af1-33c6-4fed-a33d-541a75eb89cc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:06.052085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 79/150] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:06.067261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3f0c5-c4ee-4655-b697-2b0da46dc955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:06.068305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f0c5-c4ee-4655-b697-2b0da46dc955 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.068736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f0c5-c4ee-4655-b697-2b0da46dc955 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.069837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3f0c5-c4ee-4655-b697-2b0da46dc955 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.070680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f0c5-c4ee-4655-b697-2b0da46dc955 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:06.072272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3f0c5-c4ee-4655-b697-2b0da46dc955 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:06.104152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 72/151] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:05 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:06.472870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:06.547509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d8b5e-36d8-451e-b247-0ac163d96be1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.548295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d8b5e-36d8-451e-b247-0ac163d96be1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.548567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d8b5e-36d8-451e-b247-0ac163d96be1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.550373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 73/152] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:06.556823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7581fa-e9bb-4435-b79e-4f25b27a58a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.557106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7581fa-e9bb-4435-b79e-4f25b27a58a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.557382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7581fa-e9bb-4435-b79e-4f25b27a58a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.581605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fe7581fa-e9bb-4435-b79e-4f25b27a58a6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:06.582816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fe7581fa-e9bb-4435-b79e-4f25b27a58a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:06.595728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0445f04-4bc1-44e8-ad7e-75cd6f6c8daf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:06.598718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:06.635446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdcd7e5-8f5f-42eb-80ba-6267c3e21240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:06.636199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:06.636701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcd7e5-8f5f-42eb-80ba-6267c3e21240 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.637189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcd7e5-8f5f-42eb-80ba-6267c3e21240 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.637662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdcd7e5-8f5f-42eb-80ba-6267c3e21240 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.649196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdcd7e5-8f5f-42eb-80ba-6267c3e21240 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-dfdcd7e5-8f5f-42eb-80ba-6267c3e21240 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:06.655003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:06.655942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:06.656765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:06.659458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 80/153] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:06.660897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b891-5f51-4010-8c01-884b38de38d6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.661446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b891-5f51-4010-8c01-884b38de38d6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.661920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c5b891-5f51-4010-8c01-884b38de38d6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.664078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 81/154] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:06.668428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b891-5f51-4010-8c01-884b38de38d6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:06.670124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 74/155] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:06.679287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.679469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.679683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.704596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:06.705890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:06.781346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 75/156] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:06.786133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c5b891-5f51-4010-8c01-884b38de38d6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:06.823737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:06.824725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.825222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.825689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.826551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:06.827043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:06.828632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bceb788-3354-47e8-8f97-6ccb9980f131 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:06.837427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 82/157] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:06.843004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:06.955885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787875c3-41b5-4278-988b-bedea9b27c62 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:06.966726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:06.984412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195f5f-9aae-45fd-8f4f-f25b2f0b2cbe None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:06.984742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195f5f-9aae-45fd-8f4f-f25b2f0b2cbe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:06.984957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b195f5f-9aae-45fd-8f4f-f25b2f0b2cbe None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:06.986294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 83/158] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:07.001315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.001602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.002002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.003322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.003965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.004280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.004558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.007756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:07.009262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:07.011198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 76/159] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:06 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:07.014261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.025765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:07.027063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:07.059277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:07.125437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 84/160] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:07.126297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.150326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd41c0b-1906-405e-b0bf-091f4a70a146 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.220739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.221377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.221886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.222161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.245961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:07.250953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:07.251765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:07.252714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 77/161] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:07.260949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.308825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9cdd06-dfba-4563-902a-7bd6f3cebed8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.313229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:07.362728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.363751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.364267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.364733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.387241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdc09da-b29e-496a-84ab-113956cac60f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.394268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:07.433445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.434060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.434334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.434600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.435270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:07.435566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:07.437223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:07.446410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 78/162] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:07.446851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:07.447328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.448857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:07.564768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:07.571632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 85/163] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:07.572366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4d197-a2b1-4fee-9f56-f2cd51e62d24 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.572970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.623477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.624573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.625081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.625537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.638865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:07.644744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:07.650504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:07.651357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:07.652150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:07.655388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 79/164] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:07.660449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.686648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1031ea94-fe0d-4896-ad55-c3843995b367 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.722862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.723499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.723779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.724068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] PATH_INFO: `/v3/users/424c0059899e44a9a6a3b85a4aeaedea` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.725806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] RBAC: Authorizing `identity:get_user(user_id=424c0059899e44a9a6a3b85a4aeaedea)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:07.727454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:07.729149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 86/165] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/users/424c0059899e44a9a6a3b85a4aeaedea => generated 275 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:07.729966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.780372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba13ee4-f7a5-49d2-b37c-03a9ff3191db None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.831229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.832412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.832915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.833387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.835816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95632b18-9439-44b1-8e94-e03a72441c96 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:07.857144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:07.862912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:07.863758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:07.864591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:07.873561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:07.874892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 80/166] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:07.876009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.882281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:07.882281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:07.882756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:07.883041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:07.888993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:07.890489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:07.892321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 87/167] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:07.893414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:07.921730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:08.020016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e1d39-0751-4623-984e-b58203d9728d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.094338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:08.095331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:08.095813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:08.096309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:08.097172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:08.097677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:08.099269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:08.117351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 81/168] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:08.120873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:08.124287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135f4af-c5b8-42a9-831f-60be94e5b2d5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.194692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:08.195696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:08.198808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:08.199285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:08.275809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:08.313636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:08.322658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1247f2b-b1e9-4508-904b-d1db32523231 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.324796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:08.326493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:08.394131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:08.394618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:08.394899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:08.395171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:08.395839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:08.396163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:08.398936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:08.415774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 82/169] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:08 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:08.416468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:08.430515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 88/170] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:08.431652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:08.536440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:08.547286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffb1fd2-7252-4f03-b212-4a08adcb69ff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.614922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e006fa1c-15e8-4254-a8f3-d85f535a9417 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.618768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:08.619663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:08.620219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:08.620686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] PATH_INFO: `/v3/users/188b360683ba4b74b4dc35f5cde2b951` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:08.622177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] RBAC: Authorizing `identity:get_user(user_id=188b360683ba4b74b4dc35f5cde2b951)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:08.625151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:08.628428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 89/171] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:08 2022] GET /identity/v3/users/188b360683ba4b74b4dc35f5cde2b951 => generated 247 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:08.629653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:08.691533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:08.692080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:08.692366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:08.692637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:08.693372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] RBAC: Adding query filter params (role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=424c0059899e44a9a6a3b85a4aeaedea) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:08.693677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:08.695151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:08.713285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 83/172] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:08 2022] GET /identity/v3/role_assignments?user.id=424c0059899e44a9a6a3b85a4aeaedea&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 608 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:08.714113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:08.732479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:08.813440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd71037e-7957-4a9c-aea4-60a1786d1e02 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.853170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:08.853820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:08.854484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:08.854765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] PATH_INFO: `/v3/users/c51b6ef2839044098242e3c370018bc9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:08.856843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] RBAC: Authorizing `identity:get_user(user_id=c51b6ef2839044098242e3c370018bc9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:08.858330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:08.861247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 90/173] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:08 2022] GET /identity/v3/users/c51b6ef2839044098242e3c370018bc9 => generated 289 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:08.863497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:08.916450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:08.950630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba29ceef-bd7f-46f7-8592-3319d38a9b30 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:08.998423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa4483b-f60e-4730-bfb7-58e75624a43d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:09.027005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.027648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.027925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.028220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] PATH_INFO: `/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.029531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] RBAC: Authorizing `identity:get_project(project_id=e4a80a65bdda4591a1fb9b35dd08e0b0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.031089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.032857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 84/174] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:08 2022] GET /identity/v3/projects/e4a80a65bdda4591a1fb9b35dd08e0b0 => generated 312 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:09.033734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:09.045583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d00cf1-073d-4dfa-99d2-17296debc22f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.047581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00cf1-073d-4dfa-99d2-17296debc22f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.047581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00cf1-073d-4dfa-99d2-17296debc22f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.047581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d00cf1-073d-4dfa-99d2-17296debc22f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.139107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:09.147873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00cf1-073d-4dfa-99d2-17296debc22f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.149501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d00cf1-073d-4dfa-99d2-17296debc22f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.175295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7687e1a7-b5e7-4cbf-9e3e-d868ca93895e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:09.203000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:09.227953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.229035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.229409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.229808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.231925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.234092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.235849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 85/175] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:09 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:09.236728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:09.310383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 91/176] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:09.312886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bf42-2592-4377-b74a-50b623818d4f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.313380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bf42-2592-4377-b74a-50b623818d4f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.313790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb6bf42-2592-4377-b74a-50b623818d4f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.316378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 92/177] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:09.317413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bf42-2592-4377-b74a-50b623818d4f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:09.381272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0236cc-7123-40b9-b33e-d5519c0b801d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:09.426902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.428860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.429669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.430424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.431783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, scope.project.id=e4a80a65bdda4591a1fb9b35dd08e0b0, user.id=424c0059899e44a9a6a3b85a4aeaedea) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:09.432370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.434416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.440949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 86/178] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:09 2022] GET /identity/v3/role_assignments?user.id=424c0059899e44a9a6a3b85a4aeaedea&scope.project.id=e4a80a65bdda4591a1fb9b35dd08e0b0&role.id=bf081564133f4648af5314a7102589fb => generated 608 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:09.448991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:09.453998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:09.463774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb6bf42-2592-4377-b74a-50b623818d4f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:09.499121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:09.510971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cb4b9e-fcec-491c-a44d-4bdf2a8db7d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.512278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4b9e-fcec-491c-a44d-4bdf2a8db7d6 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.512759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4b9e-fcec-491c-a44d-4bdf2a8db7d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.513228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cb4b9e-fcec-491c-a44d-4bdf2a8db7d6 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22/users/c51b6ef2839044098242e3c370018bc9/roles/1466a2f6e2bf420e8c38bd277bd60ec6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.515496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4b9e-fcec-491c-a44d-4bdf2a8db7d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd606b05c854710af4411dd179e8f22, user_id=c51b6ef2839044098242e3c370018bc9, role_id=1466a2f6e2bf420e8c38bd277bd60ec6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.518251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cb4b9e-fcec-491c-a44d-4bdf2a8db7d6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.549184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 93/179] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:09 2022] PUT /identity/v3/projects/9fd606b05c854710af4411dd179e8f22/users/c51b6ef2839044098242e3c370018bc9/roles/1466a2f6e2bf420e8c38bd277bd60ec6 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:09.550361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03383fc-23b0-4ad1-aaf6-1ad1dad34df7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.550646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03383fc-23b0-4ad1-aaf6-1ad1dad34df7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.550938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03383fc-23b0-4ad1-aaf6-1ad1dad34df7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.601357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d03383fc-23b0-4ad1-aaf6-1ad1dad34df7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:09.602601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d03383fc-23b0-4ad1-aaf6-1ad1dad34df7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:09.622954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251c6bd8-352d-4490-83d4-7a8af6b7fe36 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:09.666075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc5c1c-f0c8-4efc-b743-d46e4ebf1de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.666716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5c1c-f0c8-4efc-b743-d46e4ebf1de0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.667043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5c1c-f0c8-4efc-b743-d46e4ebf1de0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.667372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc5c1c-f0c8-4efc-b743-d46e4ebf1de0 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.668550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc5c1c-f0c8-4efc-b743-d46e4ebf1de0 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.670252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc5c1c-f0c8-4efc-b743-d46e4ebf1de0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.672580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 87/180] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:09 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:09.674010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad4cb7-6014-4a86-9eb7-b81623d4330a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.674297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad4cb7-6014-4a86-9eb7-b81623d4330a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.674572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ad4cb7-6014-4a86-9eb7-b81623d4330a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.675942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 88/181] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:09.681080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad4cb7-6014-4a86-9eb7-b81623d4330a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:09.775686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 94/182] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:09.777192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14d0c-3b1f-49fd-80fd-632535444d50 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.777371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14d0c-3b1f-49fd-80fd-632535444d50 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.777635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be14d0c-3b1f-49fd-80fd-632535444d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.796995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9be14d0c-3b1f-49fd-80fd-632535444d50 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:09.798194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9be14d0c-3b1f-49fd-80fd-632535444d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:09.807816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:09.856962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ad4cb7-6014-4a86-9eb7-b81623d4330a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:09.878237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 95/183] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:09.879552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb23b7-f38e-4547-a76f-895dcf752af1 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.879840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb23b7-f38e-4547-a76f-895dcf752af1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.880143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb23b7-f38e-4547-a76f-895dcf752af1 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.882254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 96/184] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:09.889825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.890114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.890395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.911955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:09.912788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:09.913527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:09.913714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:09.913829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:09.913975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:09.914689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=188b360683ba4b74b4dc35f5cde2b951) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:09.914993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:09.916521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:09.927345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 89/185] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:09 2022] GET /identity/v3/role_assignments?user.id=188b360683ba4b74b4dc35f5cde2b951&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:09.975605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:10.010968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 97/186] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:10.112561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.190037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.252892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148882d1-a542-4d64-ac36-b570f8132559 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.298310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.299297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.299776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.301664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.307497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:10.320992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:10.327037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:10.327896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:10.328695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 90/187] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:10.333989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.342077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f418f422-9301-415c-a50d-5bbc4a382932 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.385537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.386109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.386394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.386664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.387774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:10.389248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:10.390815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 98/188] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:10.391562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.446158 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:10.454547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b682596b-ad54-4a9a-92bf-ec1c84117dad None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.492797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.493557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.493987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.494265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.504751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2389791f-f4ac-4346-bdcc-da185ab90d66 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.504880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:10.510615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:10.511460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:10.512241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 91/189] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:10.512896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.545159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.545759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.546030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.546293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.546960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:10.547251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:10.548761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:10.557113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 99/190] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:10.562449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.577577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:10.624247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f0081b-a25b-49e4-93f0-793a50afa16b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.659199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.659731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.660009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.660317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.660962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:10.662412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:10.674729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213e0c5-b1eb-4b64-bae6-d281e2a01fee None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.686081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:10.696069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 92/191] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:10 2022] POST /identity/v3/users => generated 297 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:10.696069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.719623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.720394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.720675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.720955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.721641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:10.721945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:10.723480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:10.734691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 100/192] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:10.745205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.832626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604fbb07-a59a-4e74-b800-183ad72739ec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.853112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:10.883531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.884579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.885040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.885319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] PATH_INFO: `/v3/users/c648eec0d78f4213a0539c1c8c818989` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.893415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f2f6b9-f990-430b-b1c8-e93396f1f4ce None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:10.902280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] RBAC: Authorizing `identity:get_user(user_id=c648eec0d78f4213a0539c1c8c818989)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:10.903762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:10.905488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 93/193] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/users/c648eec0d78f4213a0539c1c8c818989 => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:10.911497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:10.942701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:10.943585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:10.943903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:10.947635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] PATH_INFO: `/v3/users/c648eec0d78f4213a0539c1c8c818989` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:10.949023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] RBAC: Authorizing `identity:get_user(user_id=c648eec0d78f4213a0539c1c8c818989)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:10.950489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:10.954860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 101/194] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/users/c648eec0d78f4213a0539c1c8c818989 => generated 283 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:10.958210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:11.014906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:11.046184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abdda33-ffa4-431d-b3e9-358c1cfaf0c0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:11.090377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-627faf05-80cc-49ad-b1e6-7682ae65ff7c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:11.099522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:11.100209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.100999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.101345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.139904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:11.141193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.142556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.143302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.150338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:11.180724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:11.182211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:11.235633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:11.237268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:11.306517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:11.338381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 94/195] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:47:11.344590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:11.452595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 102/196] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:47:11.454542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:11.484564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:11.519032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9461cf5a-c831-4504-9f5e-80a439cb708a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:11.558051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:11.561637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.562146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.562635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.564070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:11.565887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:11.569343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 95/197] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:11 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:11.575473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:11.674233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bff1a6-de20-4941-81a2-bf27bcf12eb6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:11.746786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ceb620-f676-4c30-a7b8-5ef461e5639f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:11.749945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:11.750831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.751326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.751819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.753965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:11.761331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:11.763537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 103/198] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:11 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:11.770305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:11.782351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:11.807271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:11.808145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.808426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.808694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.809825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=c648eec0d78f4213a0539c1c8c818989) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:11.810192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:11.812143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c767c5-b923-4639-a41a-f2a36802d1b5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:11.820508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 96/199] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:11 2022] GET /identity/v3/role_assignments?user.id=c648eec0d78f4213a0539c1c8c818989&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:11.821836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051fc0c-11e0-4cbc-977c-48db53759892 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.822120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051fc0c-11e0-4cbc-977c-48db53759892 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.822390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c051fc0c-11e0-4cbc-977c-48db53759892 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.828161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 97/200] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:11.832114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.832715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.833187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.849888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:11.876087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:11.876087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:11.906425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db5e0ea-94de-4d56-9562-b8aebd51503c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:11.952914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:11.953541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:11.953817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:11.954084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:11.954833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] RBAC: Adding query filter params (role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=c648eec0d78f4213a0539c1c8c818989) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:11.955137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:11.956645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:11.969753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 104/201] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:11 2022] GET /identity/v3/role_assignments?user.id=c648eec0d78f4213a0539c1c8c818989&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 259 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:12.012341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 98/202] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:12.282386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:12.365052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:12.404993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a323505f-e8ca-4e50-a68f-f54ed09d238b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:12.445865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:12.446841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:12.447319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:12.447813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:12.464965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:12.470714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:12.471580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:12.472394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:12.474649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 105/203] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:12.481146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:12.596960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaafdfe3-b2ae-41d9-8911-0e42adf0a423 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:12.628953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:12.635144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:12.635762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:12.636069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:12.636337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:12.637007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:12.637308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:12.638688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:12.648353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 99/204] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:12.653676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:12.761227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be829f-0b69-4f91-9ded-6be3c5ad2629 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:12.804063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:12.809930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:12.810611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:12.810888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:12.811160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] PATH_INFO: `/v3/users/c51b6ef2839044098242e3c370018bc9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:12.812309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] RBAC: Authorizing `identity:get_user(user_id=c51b6ef2839044098242e3c370018bc9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:12.813747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:12.815537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 106/205] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:12 2022] GET /identity/v3/users/c51b6ef2839044098242e3c370018bc9 => generated 289 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:12.821722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:12.980289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef619e5-d151-42f3-ab63-3c62c92d0280 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:13.027206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d767ea2d-46ae-4630-bb3f-6e47a09ffe3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:13.027811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ea2d-46ae-4630-bb3f-6e47a09ffe3f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.028114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ea2d-46ae-4630-bb3f-6e47a09ffe3f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.028387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d767ea2d-46ae-4630-bb3f-6e47a09ffe3f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.117728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:13.125297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767ea2d-46ae-4630-bb3f-6e47a09ffe3f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:13.126758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d767ea2d-46ae-4630-bb3f-6e47a09ffe3f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:13.259004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 100/206] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:13.265180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:13.425960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20122b20-3a6a-4a73-a98d-a6b50e53a7d3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:13.473507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5437b-d635-4935-8c7f-3c48ec8af2d8 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.474003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5437b-d635-4935-8c7f-3c48ec8af2d8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.474499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf5437b-d635-4935-8c7f-3c48ec8af2d8 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.478461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:13.479337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.479820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.480330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.481696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:13.482833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 101/207] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:13 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:13.484274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:13.486357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 107/208] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:13 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:13.492189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7649a23-fc69-4486-9cda-249f4b57f6bd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.493272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:13.494131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7649a23-fc69-4486-9cda-249f4b57f6bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.494974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7649a23-fc69-4486-9cda-249f4b57f6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.527732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e7649a23-fc69-4486-9cda-249f4b57f6bd None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:13.530625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e7649a23-fc69-4486-9cda-249f4b57f6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:13.589969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:13.605313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 102/209] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:13.612230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eacc4-b2f2-43bc-bfec-e67911b629d3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.612230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eacc4-b2f2-43bc-bfec-e67911b629d3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.612230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63eacc4-b2f2-43bc-bfec-e67911b629d3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.612230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 103/210] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:13.613811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f8e4-aead-4258-a4b7-2c35a1b09ab5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.614094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f8e4-aead-4258-a4b7-2c35a1b09ab5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.614364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b33f8e4-aead-4258-a4b7-2c35a1b09ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.632961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1b33f8e4-aead-4258-a4b7-2c35a1b09ab5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:13.634136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1b33f8e4-aead-4258-a4b7-2c35a1b09ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:13.652463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cc3b80-5d30-4d5e-9313-e17764c6db36 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:13.673717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:13.719887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:13.720963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:13.721443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:13.721915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:13.722865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] RBAC: Adding query filter params (role.id=1466a2f6e2bf420e8c38bd277bd60ec6, scope.project.id=9fd606b05c854710af4411dd179e8f22, user.id=c51b6ef2839044098242e3c370018bc9) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:13.725493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:13.729021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:13.742479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 108/211] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:13 2022] GET /identity/v3/role_assignments?user.id=c51b6ef2839044098242e3c370018bc9&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=1466a2f6e2bf420e8c38bd277bd60ec6 => generated 608 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:13.763695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 104/212] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:14.014602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.138544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ffbbe9-535b-4829-9465-1880ee4325d7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:14.143262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0781-4644-4159-9135-57550bf31556 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.144081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0781-4644-4159-9135-57550bf31556 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.144653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5a0781-4644-4159-9135-57550bf31556 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.146224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 105/213] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:14.152739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.153095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.153342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.177819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:14.183687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:14.185298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:14.187668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:14.188341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.188622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.188894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.190225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:14.192744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:14.195120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 109/214] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:14.197235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.288074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 106/215] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:14.288074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.350639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc53b2-42a4-4235-9778-d2cffd7d4925 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:14.399257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:14.404137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35855b99-4caa-4a36-9e81-30a717af383e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:14.405011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35855b99-4caa-4a36-9e81-30a717af383e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.405436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35855b99-4caa-4a36-9e81-30a717af383e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.405854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35855b99-4caa-4a36-9e81-30a717af383e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.416196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76582318-56d8-4935-8af5-4a2733cd8285 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:14.418066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35855b99-4caa-4a36-9e81-30a717af383e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-35855b99-4caa-4a36-9e81-30a717af383e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:14.423464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:14.424363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:14.425141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 110/216] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:14.431430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3bcd-4512-4880-a3c2-ff2ef1607af8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.431430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3bcd-4512-4880-a3c2-ff2ef1607af8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.431430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848e3bcd-4512-4880-a3c2-ff2ef1607af8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.431430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 111/217] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:14.431430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3bcd-4512-4880-a3c2-ff2ef1607af8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.468630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f1bff3-6c7f-415f-8e1d-772e52698328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:14.469489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1bff3-6c7f-415f-8e1d-772e52698328 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.469914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1bff3-6c7f-415f-8e1d-772e52698328 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.470430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f1bff3-6c7f-415f-8e1d-772e52698328 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.471518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1bff3-6c7f-415f-8e1d-772e52698328 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:14.473175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f1bff3-6c7f-415f-8e1d-772e52698328 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:14.499941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 107/218] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:14 2022] POST /identity/v3/users => generated 297 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:14.501875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.502738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.503417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.510569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:14.530278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:14.532120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:14.583069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848e3bcd-4512-4880-a3c2-ff2ef1607af8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:14.628988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:14.630081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.630526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.630804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.631756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:14.632350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:14.634274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:14.640918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 108/219] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:14.642113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.648216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 112/220] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:14.655112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.744268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:14.781528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89805ee-80f4-4bc4-8012-63d7e01539cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:14.790197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a611a1e7-9725-4ba3-92c4-80d5940189ba None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:14.812744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:14.823906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:14.824550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.825951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.825951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.835264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:14.836104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:14.836469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:14.836748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] PATH_INFO: `/v3/users/64be19bb80d1441d8f2cc240fe1d4932` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:14.841042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:14.845950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:14.846810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:14.847598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 109/221] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:14.854448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:14.854582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] RBAC: Authorizing `identity:get_user(user_id=64be19bb80d1441d8f2cc240fe1d4932)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:14.856408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:14.857116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 113/222] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/users/64be19bb80d1441d8f2cc240fe1d4932 => generated 297 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:14.862743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.001535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bba2a5-4def-4816-865d-91b1e0163b38 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.001821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7092d5ee-b375-4d77-bdd7-045da275e9f1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.039061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.046789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.047425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.047725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.048001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.048854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:15.049181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.050537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.051475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.052578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.053642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.054114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.059981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 110/223] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:15.060908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.118383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.152420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.154872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.174073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ed015c-16f7-4919-9898-aaa88e72519e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.219983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.221427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.221864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.222531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.237143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:15.243919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:15.245003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:15.245940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:15.248459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 111/224] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:15.249390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.281363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 114/225] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:15.286033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.329363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.381955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777d19db-d933-478a-923d-eaf2a4c330cd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.385266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.410573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c25c3-c4be-41bc-9264-8b46b9b0cdef None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.418418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.419185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.419568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.420261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] PATH_INFO: `/v3/users/c648eec0d78f4213a0539c1c8c818989` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.421312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] RBAC: Authorizing `identity:get_user(user_id=c648eec0d78f4213a0539c1c8c818989)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.422856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.424612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 112/226] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/users/c648eec0d78f4213a0539c1c8c818989 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.425532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.450115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.451026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.451476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.451915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.452782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:15.453247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.454805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.463532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 115/227] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.464547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.539094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab68af33-abec-4593-9046-808dbd3b6dc1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.560480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.576763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.577372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.577876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.577981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.579199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.580666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.581308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59f82d97-b9a3-4e67-b341-e0d0a41537a6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.587226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 113/228] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.587226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.626352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.627403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.627896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.628382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.629775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.632302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.634654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 116/229] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.635637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.647907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.698865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0149005-315c-4303-b312-0743ef70db2e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.736431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.736902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.737184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.737455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] PATH_INFO: `/v3/users/c648eec0d78f4213a0539c1c8c818989` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.738594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] RBAC: Authorizing `identity:get_user(user_id=c648eec0d78f4213a0539c1c8c818989)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.740258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.742717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 114/230] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/users/c648eec0d78f4213a0539c1c8c818989 => generated 283 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.744996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e285e-02ba-4c91-84d9-a71525a9a4c6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.748299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.781451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.782461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.783149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.783616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.784577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=64be19bb80d1441d8f2cc240fe1d4932) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:15.785081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.786764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.793888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 117/231] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/role_assignments?user.id=64be19bb80d1441d8f2cc240fe1d4932&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=bf081564133f4648af5314a7102589fb => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.795022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.811245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.875230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:15.886893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f278749c-ad78-450b-a7d5-de0d454c7d76 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.911774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b2eeba-cc40-408b-9837-c2db77e64e60 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:15.962255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7289fa5d-7640-4b9a-b7cc-4eacf6cadecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.962934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fa5d-7640-4b9a-b7cc-4eacf6cadecc None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.963218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fa5d-7640-4b9a-b7cc-4eacf6cadecc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.963492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7289fa5d-7640-4b9a-b7cc-4eacf6cadecc None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/c648eec0d78f4213a0539c1c8c818989/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.965117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:15.966000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:15.966472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:15.966934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:15.968359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.969398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289fa5d-7640-4b9a-b7cc-4eacf6cadecc None admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5fbf9827e408993b276b5e99268e0, user_id=c648eec0d78f4213a0539c1c8c818989, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:15.970338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.970831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7289fa5d-7640-4b9a-b7cc-4eacf6cadecc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:15.980352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 118/232] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:15 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:15.982787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:15.999658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 115/233] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:15 2022] PUT /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/c648eec0d78f4213a0539c1c8c818989/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:16.131871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac55b02-956c-4f8d-9c6d-95964b7331ab None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:16.170839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd2dfaf-614b-4532-94f0-686dca6ba9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:16.171854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2dfaf-614b-4532-94f0-686dca6ba9ad None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:16.172368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2dfaf-614b-4532-94f0-686dca6ba9ad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:16.172853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd2dfaf-614b-4532-94f0-686dca6ba9ad None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/c648eec0d78f4213a0539c1c8c818989/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:16.175213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2dfaf-614b-4532-94f0-686dca6ba9ad None admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5fbf9827e408993b276b5e99268e0, user_id=c648eec0d78f4213a0539c1c8c818989, role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:16.176915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd2dfaf-614b-4532-94f0-686dca6ba9ad None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:16.188354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:16.193465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 119/234] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:15 2022] PUT /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/c648eec0d78f4213a0539c1c8c818989/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:16.767532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33867a60-25b9-4004-8903-9be6b8629cdd None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:16.768311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33867a60-25b9-4004-8903-9be6b8629cdd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:16.768446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33867a60-25b9-4004-8903-9be6b8629cdd None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:16.769782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 116/235] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:16.775115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ea7d-64fc-49f7-ae04-f8ba7afdf0f6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:16.775539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ea7d-64fc-49f7-ae04-f8ba7afdf0f6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:16.775708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4064ea7d-64fc-49f7-ae04-f8ba7afdf0f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:16.805053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4064ea7d-64fc-49f7-ae04-f8ba7afdf0f6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:16.806260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4064ea7d-64fc-49f7-ae04-f8ba7afdf0f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:16.894072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 120/236] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:16.999763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614d65-f67f-4874-b607-5a120d2fb5a3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:17.000093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614d65-f67f-4874-b607-5a120d2fb5a3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:17.000346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45614d65-f67f-4874-b607-5a120d2fb5a3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:17.001845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 117/237] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:17.006845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:17.007345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:17.007807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:17.027287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:17.028741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:17.099706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 121/238] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:17.249639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45614d65-f67f-4874-b607-5a120d2fb5a3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:17.383698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45614d65-f67f-4874-b607-5a120d2fb5a3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:17.414163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:17.429371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:17.436889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:17.437391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:17.437823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:17.448421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:17.451037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:17.457004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:17.457881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:17.458651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:17.461326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 118/239] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:17 2022] GET /identity/v3/roles/reader => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:17.466564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:17.588142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801cd0ca-49b2-45cf-8df6-c458f9f82ed0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:17.626551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:17.627543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:17.628033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:17.628518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:17.629530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:17.630025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:17.631702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:17.641531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 119/240] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:17 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:17.647209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:17.653074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:17.717719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:17.762896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32ab9f7-1371-4242-84bb-61d698467506 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:17.800766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:17.802193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:17.802666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:17.803239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] PATH_INFO: `/v3/users/f7a323095b584ebdb56a3c376d86ed39` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:17.810020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37726ec8-2eee-4c68-9cc3-405d90cef17e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:17.819261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] RBAC: Authorizing `identity:get_user(user_id=f7a323095b584ebdb56a3c376d86ed39)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:17.821033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:17.823249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 120/241] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:17 2022] GET /identity/v3/users/f7a323095b584ebdb56a3c376d86ed39 => generated 297 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:17.829539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:17.883174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:17.883804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:17.884105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:17.884388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:17.886111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:17.887562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:17.891445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 122/242] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 443 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:17.898115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:18.020953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:18.030815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007d4fc-53f5-401b-931e-61c0591d4969 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:18.098101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3eb65b-5ffa-4296-b41d-a5c32702a6de None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:18.110542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:18.111156 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.111434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.111707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.156171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:18.171277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc77e18-870e-4d5a-b16a-203befda69fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:18.171897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77e18-870e-4d5a-b16a-203befda69fe None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.172204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77e18-870e-4d5a-b16a-203befda69fe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.172479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc77e18-870e-4d5a-b16a-203befda69fe None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.173140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc77e18-870e-4d5a-b16a-203befda69fe None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:18.174602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc77e18-870e-4d5a-b16a-203befda69fe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:18.223846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 123/243] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:17 2022] POST /identity/v3/users => generated 293 bytes in 326 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:18.233668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:18.237158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:18.237648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a64cce-15d7-4756-8d87-5fd90632f1f5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.237943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a64cce-15d7-4756-8d87-5fd90632f1f5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.238221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62a64cce-15d7-4756-8d87-5fd90632f1f5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.246214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 124/244] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:18 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:18.252073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.252381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.252651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.301192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:18.302459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:18.358553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 121/245] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 529 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:18.359096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:18.364178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:18.481560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 125/246] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:18.499029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16d682-68ca-477a-a934-8a51992c813c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:18.537025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5065e8a-e26d-42b2-b2fa-d9bf6c207c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:18.538446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5065e8a-e26d-42b2-b2fa-d9bf6c207c0e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.538788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5065e8a-e26d-42b2-b2fa-d9bf6c207c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.539066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5065e8a-e26d-42b2-b2fa-d9bf6c207c0e None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.540248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5065e8a-e26d-42b2-b2fa-d9bf6c207c0e None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:18.541753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5065e8a-e26d-42b2-b2fa-d9bf6c207c0e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:18.543715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 122/247] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:18 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:18.549197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:18.555201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caa083-32d8-4b67-8cec-1d6d02a08989 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.555542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caa083-32d8-4b67-8cec-1d6d02a08989 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.555822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64caa083-32d8-4b67-8cec-1d6d02a08989 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.557310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 123/248] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:18.562943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281d56-fa3b-41ae-96c3-0b93599f926b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.563230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281d56-fa3b-41ae-96c3-0b93599f926b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.563504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d281d56-fa3b-41ae-96c3-0b93599f926b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.588269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1d281d56-fa3b-41ae-96c3-0b93599f926b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:18.589504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1d281d56-fa3b-41ae-96c3-0b93599f926b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:18.657324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:18.672270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 124/249] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:18.672562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351501-8d19-4916-8ecd-7f37d0225356 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.672857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351501-8d19-4916-8ecd-7f37d0225356 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.673113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58351501-8d19-4916-8ecd-7f37d0225356 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.674489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 125/250] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:18.680314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.680558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.680789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.688027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005bc437-8e80-41a2-98d7-76b3901ed114 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:18.704785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:18.706587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:18.708986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:18.740087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:18.741147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.741442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.741664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:18.742403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] RBAC: Adding query filter params (role.id=1466a2f6e2bf420e8c38bd277bd60ec6, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=f7a323095b584ebdb56a3c376d86ed39) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:18.742712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:18.745323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:18.756870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 126/251] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:18 2022] GET /identity/v3/role_assignments?user.id=f7a323095b584ebdb56a3c376d86ed39&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=1466a2f6e2bf420e8c38bd277bd60ec6 => generated 259 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:18.792862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:18.803151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 126/252] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:18.959112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e34dcfa-9094-48a8-984a-fd838edf4305 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:18.995583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:18.996174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:18.996457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:18.996726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.008515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:19.009498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:19.013838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:19.014700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:19.015486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 127/253] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:19.021156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.064490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:19.173570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d33304-ab91-4310-a42d-5c59a8112734 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.191544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdc8180d-896f-4b9b-aa15-f8372da350f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.210483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.211258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.211542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.211814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.212515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:19.213104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:19.214275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:19.220235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:19.224287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 128/254] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:19.229942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.233236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.233986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.234367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.234769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.247251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:19.252527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:19.253560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:19.254504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:19.255657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 127/255] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:19.257548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.343489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:19.354380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab831c5e-68e8-4c33-ace5-ab9126a99128 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.387153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab004a39-22ea-42df-bbd3-26ba1df71f3c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.391788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.392529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.393128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.393469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.404666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:19.410395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:19.411268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:19.412016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:19.413371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 129/256] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:19.413901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.469726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.470376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.470658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.470934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] PATH_INFO: `/v3/users/64be19bb80d1441d8f2cc240fe1d4932` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.472768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] RBAC: Authorizing `identity:get_user(user_id=64be19bb80d1441d8f2cc240fe1d4932)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:19.474245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:19.478063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 128/257] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/users/64be19bb80d1441d8f2cc240fe1d4932 => generated 297 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:19.481324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.561052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b029eea3-a438-4862-a07f-cfdc47a20fd3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.598448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.599060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.599344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.599706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.600625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:19.600946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:19.602511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:19.608071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:19.612124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 130/258] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:19.617599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.645449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:19.726910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2271d-4e24-45a0-882b-f8544ab1582d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.761884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.762109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38839c2-1466-4d1e-8b9b-e96149180e44 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.762521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.762803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.763552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.764839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:19.766391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:19.768540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 131/259] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:19.769560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.834963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:19.835576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:19.835875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:19.836157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:19.836824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:19.837128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:19.838495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:19.858539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 129/260] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:19.859368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:19.922674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:19.953232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414579ea-d2f9-432a-8060-1a8f5480c8b8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.981910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf241a-ae2b-4a5a-b187-1b6b8a5fe30d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:19.997175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:20.023614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:20.024324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:20.024548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:20.024823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] PATH_INFO: `/v3/users/c648eec0d78f4213a0539c1c8c818989` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:20.027052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] RBAC: Authorizing `identity:get_user(user_id=c648eec0d78f4213a0539c1c8c818989)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:20.028547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:20.030311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 132/261] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:19 2022] GET /identity/v3/users/c648eec0d78f4213a0539c1c8c818989 => generated 283 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:20.030900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:20.038701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:20.039369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:20.039644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:20.039914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/64be19bb80d1441d8f2cc240fe1d4932/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:20.041949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5fbf9827e408993b276b5e99268e0, user_id=64be19bb80d1441d8f2cc240fe1d4932, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:20.043390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:20.083360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 130/262] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:19 2022] PUT /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/64be19bb80d1441d8f2cc240fe1d4932/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:20.083999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:20.216711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b6826d-8b1f-4067-a52b-4f82f9ab8d59 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:20.257211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:20.257955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:20.258235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:20.258507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] PATH_INFO: `/v3/users/c648eec0d78f4213a0539c1c8c818989` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:20.260545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] RBAC: Authorizing `identity:get_user(user_id=c648eec0d78f4213a0539c1c8c818989)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:20.261997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:20.264980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 133/263] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:20 2022] GET /identity/v3/users/c648eec0d78f4213a0539c1c8c818989 => generated 283 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:20.271295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:20.299482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de09ca46-c9fe-4168-9e59-ddcc01d63505 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:20.333313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:20.378389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:20.379061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:20.379344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:20.379617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:20.428558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed6ecf4-3ffa-4e8e-a627-36c6814c3136 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:20.464251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:20.465094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:20.465704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:20.465984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:20.466256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:20.534904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:20.536334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:20.536525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:20.538748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:20.568824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:20.641091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 134/264] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:20.648226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:20.776652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 131/265] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 693 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:20.782531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:20.786001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9381e7-9bd0-42c5-9e79-3e2566d60e9f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:20.813926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:20.823322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:20.823981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:20.824308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:20.824645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:20.826090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:20.827672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:20.829747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 135/266] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:20 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:20.836609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:20.917002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:20.972081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41630c64-56c3-4378-a19a-f86b8463c717 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:20.974430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082f080-a1de-4004-84e9-d0944bd7bae9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:21.006408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:21.007029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.007305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.007569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.008358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=c648eec0d78f4213a0539c1c8c818989) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:21.008922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:21.010197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:21.024071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 136/267] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:20 2022] GET /identity/v3/role_assignments?user.id=c648eec0d78f4213a0539c1c8c818989&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:21.047839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0343d362-fc3e-477a-9722-41d97ba37d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:21.048590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343d362-fc3e-477a-9722-41d97ba37d1f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.048976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343d362-fc3e-477a-9722-41d97ba37d1f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.049380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0343d362-fc3e-477a-9722-41d97ba37d1f None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.050682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343d362-fc3e-477a-9722-41d97ba37d1f None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:21.052265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0343d362-fc3e-477a-9722-41d97ba37d1f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:21.054289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 132/268] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:20 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:21.061409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:21.148429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:21.208938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0e7d67-a209-40a0-a572-de1219cb877d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:21.260020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:21.260665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.260945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.261220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.261965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] RBAC: Adding query filter params (role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=c648eec0d78f4213a0539c1c8c818989) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:21.262277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:21.263722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef143fa4-e08e-4557-ac7f-465698612bed None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:21.273858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 137/269] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:21 2022] GET /identity/v3/role_assignments?user.id=c648eec0d78f4213a0539c1c8c818989&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 608 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:21.447706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66d03-ab15-4d3b-bccb-4f19f8a199f3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.448147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66d03-ab15-4d3b-bccb-4f19f8a199f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.448327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a66d03-ab15-4d3b-bccb-4f19f8a199f3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.449658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 133/270] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:21.455480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf71bc-abc0-496f-b565-643c6d6082e4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.455752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf71bc-abc0-496f-b565-643c6d6082e4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.456027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf71bc-abc0-496f-b565-643c6d6082e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.480203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3fcf71bc-abc0-496f-b565-643c6d6082e4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:21.481415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3fcf71bc-abc0-496f-b565-643c6d6082e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:21.498908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbd51f-0859-4ac1-bdd4-363e707ef41b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.499193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbd51f-0859-4ac1-bdd4-363e707ef41b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.499469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cbd51f-0859-4ac1-bdd4-363e707ef41b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.501201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 134/271] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:21.508872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55e354-379a-4c30-916b-b863897c7c6a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.509232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55e354-379a-4c30-916b-b863897c7c6a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.509579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b55e354-379a-4c30-916b-b863897c7c6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.546366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0b55e354-379a-4c30-916b-b863897c7c6a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:21.548024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0b55e354-379a-4c30-916b-b863897c7c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:21.602519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 138/272] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:21.641462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 135/273] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:21.643514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e0c6-52a6-414b-b770-ffc7f4604d4f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.643793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e0c6-52a6-414b-b770-ffc7f4604d4f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.644122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5796e0c6-52a6-414b-b770-ffc7f4604d4f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.645686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 139/274] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:21.651510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:21.651797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:21.652103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:21.673943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:21.675126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:21.766214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 136/275] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:21.929140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796e0c6-52a6-414b-b770-ffc7f4604d4f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:21.948575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:21.951216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.000222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.057145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5796e0c6-52a6-414b-b770-ffc7f4604d4f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.063330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bdeb03-6a08-4e0e-a33b-035e106d58ac None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.094001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.094640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.094916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.095189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.096378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.097887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.099465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 140/276] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:22.100546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.106918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.108125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.108125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.108125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.119127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:22.123810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:22.124803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:22.125578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 137/277] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:22.126224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.188230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.227232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02fe73c-0e15-447d-be4e-f47871941e15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.233625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb17dbef-89d2-4ef7-9956-2fcb4ef9aa00 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.259200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.266656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.267545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.268109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.268568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.269510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.271230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.273911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.274616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.274900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.275174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.285733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:22.290976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:22.291861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:22.292690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:22.295968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 138/278] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:22 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:22.296825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.304499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 141/279] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/roles/reader => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:22.309177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.435872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4768ea8a-9fa1-4b64-9034-e25c16379483 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.437690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96a8ac6-6598-4924-bcb0-b8c299838d94 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.458320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.481030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.482109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.482389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.482688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.483330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:22.483635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.485086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.485694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.486298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.486734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.487009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.488097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:22.490028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.490682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.494484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 139/280] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:22.500308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.503155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 142/281] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:22.509398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.560333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.617890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc1d6a7-5387-4c7a-99db-2c6d056b5c8c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.630183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1f5755-056b-4de4-8724-6ccf3d821c5a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.665134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7871080-5416-4616-9833-857118ee8917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.665814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7871080-5416-4616-9833-857118ee8917 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.666097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7871080-5416-4616-9833-857118ee8917 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.666370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7871080-5416-4616-9833-857118ee8917 None admin] PATH_INFO: `/v3/users/3798e900783c431185329742560e3f20` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.673445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de455fa0-5826-4668-b7be-7bd4f50796cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.674087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455fa0-5826-4668-b7be-7bd4f50796cc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.674366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455fa0-5826-4668-b7be-7bd4f50796cc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.674640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de455fa0-5826-4668-b7be-7bd4f50796cc None admin] PATH_INFO: `/v3/users/f7a323095b584ebdb56a3c376d86ed39` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.675900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455fa0-5826-4668-b7be-7bd4f50796cc None admin] RBAC: Authorizing `identity:get_user(user_id=f7a323095b584ebdb56a3c376d86ed39)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.677458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de455fa0-5826-4668-b7be-7bd4f50796cc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.679911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 143/282] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/users/f7a323095b584ebdb56a3c376d86ed39 => generated 297 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:22.681098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3e386-94bb-4515-8e3b-65cdc9636a38 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.681376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3e386-94bb-4515-8e3b-65cdc9636a38 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.681645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b3e386-94bb-4515-8e3b-65cdc9636a38 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.682157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7871080-5416-4616-9833-857118ee8917 None admin] RBAC: Authorizing `identity:get_user(user_id=3798e900783c431185329742560e3f20)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.684016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 144/283] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:22.684238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7871080-5416-4616-9833-857118ee8917 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.685432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3e386-94bb-4515-8e3b-65cdc9636a38 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.690557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 140/284] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/users/3798e900783c431185329742560e3f20 => generated 293 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:22.691872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.692189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.692490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.714321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:22.715528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:22.749386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.791476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 141/285] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:22.792407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.835384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b3e386-94bb-4515-8e3b-65cdc9636a38 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:22.858659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:22.912746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:22.915467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:22.917421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:22.917927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:22.920883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:22.922512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:22.930641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 145/286] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:22.936086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:22.988542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6acc3a-5312-46f5-a934-0dcc60b1fb8d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:23.070120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:23.070735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:23.071018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:23.071292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:23.072033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, user.id=3798e900783c431185329742560e3f20, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:23.072289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdc84b9-2cbd-4f8a-b5b1-008ed125ddac None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:23.072722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:23.073791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:23.089732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 142/287] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Aug 25 02:47:22 2022] GET /identity/v3/role_assignments?user.id=3798e900783c431185329742560e3f20&scope.system=all&role.id=bf081564133f4648af5314a7102589fb => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:23.090512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:23.127215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:23.136831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:23.137517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:23.137799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:23.138072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/f7a323095b584ebdb56a3c376d86ed39/roles/1466a2f6e2bf420e8c38bd277bd60ec6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:23.145593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5fbf9827e408993b276b5e99268e0, user_id=f7a323095b584ebdb56a3c376d86ed39, role_id=1466a2f6e2bf420e8c38bd277bd60ec6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:23.149748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:23.175711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 146/288] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:47:22 2022] PUT /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0/users/f7a323095b584ebdb56a3c376d86ed39/roles/1466a2f6e2bf420e8c38bd277bd60ec6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:23.251649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86e7cd5-5687-45a6-8225-4f7d87ec93bd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:23.300442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:23.301090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:23.301364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:23.301632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:23.317993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:23.323943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:23.324929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:23.325708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 143/289] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:23.332902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:23.382243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:23.450824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b782d41-137d-4b14-8c27-b92d650347b2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:23.491079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:23.492140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:23.492623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:23.493119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:23.493992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:23.494512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:23.496196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:23.507109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 147/290] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:23.512945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:23.611944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:23.622567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea8000-419b-429b-bbfa-d7551f7f058f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:23.663350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:23.664242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:23.664740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:23.665159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] PATH_INFO: `/v3/users/64be19bb80d1441d8f2cc240fe1d4932` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:23.668737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] RBAC: Authorizing `identity:get_user(user_id=64be19bb80d1441d8f2cc240fe1d4932)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:23.670356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:23.672262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 144/291] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:23 2022] GET /identity/v3/users/64be19bb80d1441d8f2cc240fe1d4932 => generated 297 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:23.678215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:23.795386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:23.799206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ad1e5-9e93-4138-940a-f48e9f0f1cfe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:23.846893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:23.847514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:23.847797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:23.848089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:23.944352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:23.944352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:24.089924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:24.094484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 148/292] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:24.099750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:24.246222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb44446-e971-4249-887e-4d9968177e65 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:24.282954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174edb43-7960-48ef-b058-a93cf75ae889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:24.283944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174edb43-7960-48ef-b058-a93cf75ae889 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:24.284477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174edb43-7960-48ef-b058-a93cf75ae889 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:24.284952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174edb43-7960-48ef-b058-a93cf75ae889 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:24.286281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174edb43-7960-48ef-b058-a93cf75ae889 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:24.288966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174edb43-7960-48ef-b058-a93cf75ae889 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:24.291232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 145/293] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:24 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:24.301141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:24.483639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2afccf-1d31-430c-ab0d-eb8f93f9e984 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:24.520707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:24.521233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:24.521625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:24.521904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:24.522627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=64be19bb80d1441d8f2cc240fe1d4932) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:24.522930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:24.524391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f570b9b-cad9-4507-bd11-0843422e7a6c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:24.530793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 149/294] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:24 2022] GET /identity/v3/role_assignments?user.id=64be19bb80d1441d8f2cc240fe1d4932&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=bf081564133f4648af5314a7102589fb => generated 608 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:24.819465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f720-0860-4126-821d-d2f10daaab9f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:24.819841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f720-0860-4126-821d-d2f10daaab9f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:24.819942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1196f720-0860-4126-821d-d2f10daaab9f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:24.821498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 146/295] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:24.826937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fafa66-5b01-44bc-a4da-6f86cc6a03f7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:24.827455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fafa66-5b01-44bc-a4da-6f86cc6a03f7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:24.827924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2fafa66-5b01-44bc-a4da-6f86cc6a03f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:24.847113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e2fafa66-5b01-44bc-a4da-6f86cc6a03f7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:24.848636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e2fafa66-5b01-44bc-a4da-6f86cc6a03f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:24.913024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:24.923677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 150/296] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:24.993685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eee35-8ca4-44f1-9cb7-9ae7d9278679 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:24.994001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eee35-8ca4-44f1-9cb7-9ae7d9278679 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:24.994241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492eee35-8ca4-44f1-9cb7-9ae7d9278679 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:24.995593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 147/297] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:25.001756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.002036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.002308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.023531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:25.024750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:25.102841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 151/298] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:25.213044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eee35-8ca4-44f1-9cb7-9ae7d9278679 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:25.244503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:25.323515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492eee35-8ca4-44f1-9cb7-9ae7d9278679 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:25.360064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:25.360626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.360909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.361186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.371967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:25.376712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:25.377562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:25.378349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 148/299] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:25 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:25.382069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:25.384111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:25.480401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:25.490007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8008147c-9084-4972-a423-e1ac267ddc6c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:25.494806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45eff3b8-8f78-440a-b06b-8f09bf3d3ec7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:25.519136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:25.532521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:25.533498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.533977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.534432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:25.534700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.535048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.535328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.535601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.536315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:25.536617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:25.537571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:25.538926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:25.539583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:25.542187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 152/300] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:25.547646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:25.551953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 149/301] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:25.558584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:25.663411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0132fbf8-49c8-42bd-bbe6-6512b1775f80 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:25.665643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a09fe2-aae7-43d5-a672-1e35e0fe123d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:25.696717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845a28ea-ddee-4b19-a39e-96b5788bfcb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:25.697342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a28ea-ddee-4b19-a39e-96b5788bfcb1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.697617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a28ea-ddee-4b19-a39e-96b5788bfcb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.697890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845a28ea-ddee-4b19-a39e-96b5788bfcb1 None admin] PATH_INFO: `/v3/users/08fd8d84954642208f89051c1d2fe8c1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.699550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5aefb73-67a0-45e5-b279-b02a13f76425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:25.700179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aefb73-67a0-45e5-b279-b02a13f76425 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.700463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aefb73-67a0-45e5-b279-b02a13f76425 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.700736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5aefb73-67a0-45e5-b279-b02a13f76425 None admin] PATH_INFO: `/v3/groups` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.701351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aefb73-67a0-45e5-b279-b02a13f76425 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:25.702786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5aefb73-67a0-45e5-b279-b02a13f76425 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:25.711748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a28ea-ddee-4b19-a39e-96b5788bfcb1 None admin] RBAC: Authorizing `identity:get_user(user_id=08fd8d84954642208f89051c1d2fe8c1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:25.713596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845a28ea-ddee-4b19-a39e-96b5788bfcb1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:25.715147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 150/302] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:25 2022] GET /identity/v3/users/08fd8d84954642208f89051c1d2fe8c1 => generated 293 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:25.727733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 153/303] 10.222.0.72 () {60 vars in 1134 bytes} [Thu Aug 25 02:47:25 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:47:25.728014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf992d-3d53-48d6-a731-ee4784bf139a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.728118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988b9e-d186-4251-92af-d92e5823d9ea None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.728199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf992d-3d53-48d6-a731-ee4784bf139a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.728390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988b9e-d186-4251-92af-d92e5823d9ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.728475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdf992d-3d53-48d6-a731-ee4784bf139a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.728541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48988b9e-d186-4251-92af-d92e5823d9ea None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.728541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 154/305] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:25.728681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 151/305] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:25.728745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988b9e-d186-4251-92af-d92e5823d9ea None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:25.729834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049f85c-ea62-4636-9cf1-a7df488c2906 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.730117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049f85c-ea62-4636-9cf1-a7df488c2906 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.730386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049f85c-ea62-4636-9cf1-a7df488c2906 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.749975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4049f85c-ea62-4636-9cf1-a7df488c2906 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:25.751223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4049f85c-ea62-4636-9cf1-a7df488c2906 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:25.753687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:25.794635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:25.836091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 152/306] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:25.836091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.836091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.836091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.856112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:25.857492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:25.862369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48988b9e-d186-4251-92af-d92e5823d9ea None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:25.911136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:25.911746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:25.912795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:25.913151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:25.914420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] RBAC: Adding query filter params (role.id=1466a2f6e2bf420e8c38bd277bd60ec6, user.id=08fd8d84954642208f89051c1d2fe8c1, scope.system=all) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:25.914420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:25.915634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:25.922646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 155/307] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Aug 25 02:47:25 2022] GET /identity/v3/role_assignments?user.id=08fd8d84954642208f89051c1d2fe8c1&scope.system=all&role.id=1466a2f6e2bf420e8c38bd277bd60ec6 => generated 226 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:25.949409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 153/308] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:26.120232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.225541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7c9e89e-b078-4765-a08a-4032ceb38a52 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.227112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.244619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:26.268573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.269221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.269505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.269807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.283690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:26.290264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:26.291236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:26.292190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 156/309] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:26.297248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.323271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:26.370084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e6b0c4-6263-4127-9c19-ce616162ddf8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.411997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.413288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.413569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.413839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.422453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3df8769-7e81-48ee-8f98-ee018515cc73 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.430934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:26.437660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:26.438718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:26.439689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:26.442140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 154/310] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:26.451663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.474381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.475358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.476120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.476337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.477018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:26.477319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:26.478756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:26.491053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 157/311] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:26.496495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.550574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:26.576860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13535c44-6278-4128-9dcc-0d25f94ff34e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.612178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:26.617678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cb078-a9ae-4b13-801e-519800783c2d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.623153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.623754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.624026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.624318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.624980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:26.625276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:26.627190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:26.638400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 155/312] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:26.644496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.665268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.666292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.666575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.666847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] PATH_INFO: `/v3/users/3798e900783c431185329742560e3f20` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.667980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] RBAC: Authorizing `identity:get_user(user_id=3798e900783c431185329742560e3f20)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:26.670102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:26.672319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 158/313] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/users/3798e900783c431185329742560e3f20 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:26.678779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.772745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d098b-575e-4f19-87e4-42068d900b67 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.807255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59a2f5e-858b-4c02-9d39-f95a1670e2db None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.814758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.815381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.815655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.815924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] PATH_INFO: `/v3/users/f7a323095b584ebdb56a3c376d86ed39` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.817546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:26.817767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] RBAC: Authorizing `identity:get_user(user_id=f7a323095b584ebdb56a3c376d86ed39)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:26.820572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:26.826793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 156/314] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/users/f7a323095b584ebdb56a3c376d86ed39 => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:26.828347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:26.863136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:26.864848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:26.866266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:26.866958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] PATH_INFO: `/v3/system/users/3798e900783c431185329742560e3f20/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:26.869978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=3798e900783c431185329742560e3f20, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:26.871642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:26.888665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 159/315] 10.222.0.72 () {58 vars in 1334 bytes} [Thu Aug 25 02:47:26 2022] PUT /identity/v3/system/users/3798e900783c431185329742560e3f20/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:26.907196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:26.960329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e80ddf-cd23-4bc6-a522-dabed3fdccae None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:26.999837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:27.000553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:27.000834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:27.001102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:27.075712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:27.077127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:27.136231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:27.180829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 157/316] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:27.186582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:27.294936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa366c8-12cf-4d0d-8e95-62e7aef7d7fe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:27.330484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21bdf2a3-b269-40cc-a4df-4aca99c32edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:27.331056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf2a3-b269-40cc-a4df-4aca99c32edb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:27.331346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf2a3-b269-40cc-a4df-4aca99c32edb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:27.331657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21bdf2a3-b269-40cc-a4df-4aca99c32edb None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:27.332779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf2a3-b269-40cc-a4df-4aca99c32edb None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:27.334321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21bdf2a3-b269-40cc-a4df-4aca99c32edb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:27.340394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 160/317] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:27 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:27.342306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:27.453399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aade31ff-8ff3-4879-8de8-3ca86f39a713 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:27.490730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:27.492033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:27.492664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:27.493280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:27.494616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] RBAC: Adding query filter params (role.id=1466a2f6e2bf420e8c38bd277bd60ec6, scope.project.id=b1b5fbf9827e408993b276b5e99268e0, user.id=f7a323095b584ebdb56a3c376d86ed39) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:27.495264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:27.496988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfacfd61-ab76-4ab4-9c39-2e015d760f6f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:27.504020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 158/318] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:27 2022] GET /identity/v3/role_assignments?user.id=f7a323095b584ebdb56a3c376d86ed39&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=1466a2f6e2bf420e8c38bd277bd60ec6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:27.871962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac399253-c324-4959-bf3f-245e3d1f4fee None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:27.872357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac399253-c324-4959-bf3f-245e3d1f4fee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:27.872562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac399253-c324-4959-bf3f-245e3d1f4fee None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:27.874067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 161/319] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:27.879154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6c36-b83a-456b-98ff-87b2dcf03ae0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:27.879445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6c36-b83a-456b-98ff-87b2dcf03ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:27.879717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364d6c36-b83a-456b-98ff-87b2dcf03ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:27.898691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-364d6c36-b83a-456b-98ff-87b2dcf03ae0 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:27.899869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-364d6c36-b83a-456b-98ff-87b2dcf03ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:27.918052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:27.971311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 159/320] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:28.027698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86531c9-20d8-45fc-834b-3daf92ccb6be None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.028004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86531c9-20d8-45fc-834b-3daf92ccb6be None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.028282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86531c9-20d8-45fc-834b-3daf92ccb6be None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.029774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 162/321] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:28.035221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.035505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.035770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.055123 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:28.056336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:28.122454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 160/322] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:28.243815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86531c9-20d8-45fc-834b-3daf92ccb6be None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:28.289199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:28.354154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f86531c9-20d8-45fc-834b-3daf92ccb6be None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:28.387388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:28.387935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.388243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.388516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.389603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:28.391036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:28.393094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 163/323] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:28.394632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:28.398874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:28.490388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:28.503870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0153695e-147c-4262-9053-22e2ae6bec6a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:28.510840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36495ec7-604e-4e7c-b435-ee78a68ad866 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:28.512350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:28.543907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:28.544553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.544844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.545113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] PATH_INFO: `/v3/groups` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.545743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:28.547187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:28.548226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:28.549022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.549436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.549837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.561427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:28.572413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 164/324] 10.222.0.72 () {60 vars in 1134 bytes} [Thu Aug 25 02:47:28 2022] POST /identity/v3/groups => generated 226 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:28.572618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:28.574040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:28.574850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 161/325] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:28 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:28.578255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:28.696413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eeb962c-6a38-4512-b117-9b2de21749af None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:28.741306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:28.741968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.742260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.742537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.743212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:28.743518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:28.744922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37601443-6db2-4677-bad6-77cd34ac8fb7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:28.754612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 165/326] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:28 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:28.760200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:28.872244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f8c460-9cf8-443b-9eaf-ba392790856b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:28.892967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326b15-db61-4aed-980e-dbdfc7ff93a6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.893296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326b15-db61-4aed-980e-dbdfc7ff93a6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.893530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c326b15-db61-4aed-980e-dbdfc7ff93a6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.895143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 166/327] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:28.901253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.901812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.902290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.915768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:28.916459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:28.917331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:28.917608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] PATH_INFO: `/v3/users/08fd8d84954642208f89051c1d2fe8c1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:28.918778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] RBAC: Authorizing `identity:get_user(user_id=08fd8d84954642208f89051c1d2fe8c1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:28.920294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:28.922029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 162/328] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:28 2022] GET /identity/v3/users/08fd8d84954642208f89051c1d2fe8c1 => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:28.922230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:28.924825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:28.928189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:28.942268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:28.957868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:29.012455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 167/329] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:29.055658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8201f-b924-4b11-bec6-71c5118e2382 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:29.091367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:29.092385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:29.092839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:29.093283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] PATH_INFO: `/v3/system/users/08fd8d84954642208f89051c1d2fe8c1/roles/1466a2f6e2bf420e8c38bd277bd60ec6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:29.094888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=08fd8d84954642208f89051c1d2fe8c1, role_id=1466a2f6e2bf420e8c38bd277bd60ec6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:29.096491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:29.107880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 163/330] 10.222.0.72 () {58 vars in 1334 bytes} [Thu Aug 25 02:47:28 2022] PUT /identity/v3/system/users/08fd8d84954642208f89051c1d2fe8c1/roles/1466a2f6e2bf420e8c38bd277bd60ec6 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:47:29.305278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:29.418304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85366a7f-b8cf-41c7-8336-070fd3e4ae33 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:29.459482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:29.460141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:29.460426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:29.460698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:29.471420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:29.476469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:29.477351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:29.478138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 168/331] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:29.483754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:29.576763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:29.609272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d2cfed-f475-4257-b3b9-2896f9f243cb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:29.653736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:29.654360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:29.654640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:29.654966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:29.655648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:29.655951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:29.657360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:29.669182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 164/332] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:29.674776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:29.702668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:29.812466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3fc3dbc-b9b3-4718-95a6-0f417ac8b7c2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:29.859370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50dcb323-9044-458b-96c3-394f249213f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:29.860019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb323-9044-458b-96c3-394f249213f1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:29.860320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb323-9044-458b-96c3-394f249213f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:29.860591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dcb323-9044-458b-96c3-394f249213f1 None admin] PATH_INFO: `/v3/users/3798e900783c431185329742560e3f20` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:29.864867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb323-9044-458b-96c3-394f249213f1 None admin] RBAC: Authorizing `identity:get_user(user_id=3798e900783c431185329742560e3f20)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:29.867066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50dcb323-9044-458b-96c3-394f249213f1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:29.869155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 169/333] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:29 2022] GET /identity/v3/users/3798e900783c431185329742560e3f20 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:29.874991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:30.028987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca394d0a-f6a8-43ca-b691-e640adecd80a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:30.075960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:30.076619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:30.076903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:30.077179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:30.077972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] RBAC: Adding query filter params (role.id=bf081564133f4648af5314a7102589fb, user.id=3798e900783c431185329742560e3f20, scope.system=all) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:30.078287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:30.079794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c513de2b-a160-473d-ad2e-90f8d67ab6b6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:30.082533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:30.096356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 165/334] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Aug 25 02:47:29 2022] GET /identity/v3/role_assignments?user.id=3798e900783c431185329742560e3f20&scope.system=all&role.id=bf081564133f4648af5314a7102589fb => generated 510 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:31.090163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828e18-50f9-4671-b9d6-f1cbd3ec01d7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.090661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828e18-50f9-4671-b9d6-f1cbd3ec01d7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.090734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3828e18-50f9-4671-b9d6-f1cbd3ec01d7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.092496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 170/335] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:31.108793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ade7f-9a30-4d3d-9055-24e6c21d256c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.109295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ade7f-9a30-4d3d-9055-24e6c21d256c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.109372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08ade7f-9a30-4d3d-9055-24e6c21d256c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.133612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b08ade7f-9a30-4d3d-9055-24e6c21d256c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:31.134817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b08ade7f-9a30-4d3d-9055-24e6c21d256c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:31.220033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 166/336] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:31.332069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbacbf-775a-48c5-9d00-9b619d6e379b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.332406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbacbf-775a-48c5-9d00-9b619d6e379b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.332621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbacbf-775a-48c5-9d00-9b619d6e379b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.334793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 171/337] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:31.340568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.340852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.341127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.368339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:31.369880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:31.445198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 167/338] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:31.577205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbacbf-775a-48c5-9d00-9b619d6e379b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:31.700871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:31.720170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbacbf-775a-48c5-9d00-9b619d6e379b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:31.764151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cc74fa7-a6ce-4ff0-8c8f-4d189be5e913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:31.765157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc74fa7-a6ce-4ff0-8c8f-4d189be5e913 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.765639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc74fa7-a6ce-4ff0-8c8f-4d189be5e913 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.766134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc74fa7-a6ce-4ff0-8c8f-4d189be5e913 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.777680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cc74fa7-a6ce-4ff0-8c8f-4d189be5e913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3cc74fa7-a6ce-4ff0-8c8f-4d189be5e913 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:31.782768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:31.783639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:31.784458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:31.787511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 172/339] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:31.794140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:31.881317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:31.938499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b768434-f463-42d6-9548-f203d28e5015 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:31.963060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258567-b8ea-4f4d-b405-fd3b6666649a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.963817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258567-b8ea-4f4d-b405-fd3b6666649a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.964368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c258567-b8ea-4f4d-b405-fd3b6666649a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.966160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 173/340] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:31.972515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258567-b8ea-4f4d-b405-fd3b6666649a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:31.977126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:31.979360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.979360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.979360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:31.979360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] RBAC: Adding query filter params (name=member) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:31.979655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:31.981954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5de5879-606f-4e36-b18f-f45efce39f7d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:31.993405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 168/341] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:31.994983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:31.995268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:31.995543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.019477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:32.021373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:32.107995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c258567-b8ea-4f4d-b405-fd3b6666649a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:32.120597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 169/342] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:32.122529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:32.173387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:32.173960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.174244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.174522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.176643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:32.193763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:32.199313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:32.200221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:32.201029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:32.208585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 174/343] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:32.214441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:32.229538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:32.245226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31e3156-3c27-42fb-a7bf-cc8f052ee2a6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:32.283558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebb0d97-f271-4a08-986e-85f6ef00b9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:32.284693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0d97-f271-4a08-986e-85f6ef00b9b6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.285184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0d97-f271-4a08-986e-85f6ef00b9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.285669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebb0d97-f271-4a08-986e-85f6ef00b9b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.357230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a00d-a4fb-4443-bf8c-6e291ac1753e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:32.366042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb0d97-f271-4a08-986e-85f6ef00b9b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:32.367974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebb0d97-f271-4a08-986e-85f6ef00b9b6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:32.392818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:32.393424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.393707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.393984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.394675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:32.394964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:32.396446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7910f2b7-c81b-4010-8049-462af78b0325 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:32.405017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 175/344] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:32.406248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8469c0-65d2-41aa-a0c3-59191a67c1d5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.406533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8469c0-65d2-41aa-a0c3-59191a67c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.406808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8469c0-65d2-41aa-a0c3-59191a67c1d5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.408071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 176/345] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:32 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:32.411124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8469c0-65d2-41aa-a0c3-59191a67c1d5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:32.423062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:32.486507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:32.513455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 170/346] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:32.515224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.515711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.516367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.524496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8469c0-65d2-41aa-a0c3-59191a67c1d5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:32.543880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:32.545454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:32.561685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:32.562300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.563396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.563396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.637988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:32.639477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:32.663177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 171/347] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:32.664386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:32.730856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:32.784021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 177/348] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:32.790259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:32.799659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:32.834711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a901ea8d-a15c-4d39-a5a7-5a42518e8de2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:32.874746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:32.875719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.876293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.876763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.878116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:32.879822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:32.882761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 172/349] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:32.883818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:32.935462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ddc135-b2b4-42eb-8ea9-15df0533754b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:32.975332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:32.976082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:32.976370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:32.976644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:32.977849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:32.979287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:32.980969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 178/350] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:32.981742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.019235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.065389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee86b4d-4a65-4226-b225-2658c412a3f5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.089888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf4d779-2d76-43a5-aebc-219324f6694a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.125552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.126074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.126414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.126486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.126768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.127595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.128108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.128593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.134157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:33.135614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:33.137612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 179/351] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:33.142310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.158124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:33.163991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:33.164908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:33.165713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 173/352] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:33.166356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.177533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.254479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.261385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523e09e-5049-4ae8-a891-90ac5440e412 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.309349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0f1637-210d-4f01-bfb7-bd2f70f352cb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.311408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5589451e-f5f3-418f-bbbe-974beb0f5706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.312292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589451e-f5f3-418f-bbbe-974beb0f5706 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.312575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589451e-f5f3-418f-bbbe-974beb0f5706 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.312850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5589451e-f5f3-418f-bbbe-974beb0f5706 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.314003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589451e-f5f3-418f-bbbe-974beb0f5706 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:33.315508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5589451e-f5f3-418f-bbbe-974beb0f5706 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:33.317073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 180/353] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:33.318227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b12c-9738-4a41-80ea-f4ed1dcec1c8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.318518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b12c-9738-4a41-80ea-f4ed1dcec1c8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.318797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206b12c-9738-4a41-80ea-f4ed1dcec1c8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.320181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 181/354] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:33 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:33.324752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b12c-9738-4a41-80ea-f4ed1dcec1c8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.357161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.358014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.358315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.358571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.359307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=bf081564133f4648af5314a7102589fb, scope.project.id=9fd606b05c854710af4411dd179e8f22) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:33.359615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:33.361098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:33.373739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 174/355] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=bf081564133f4648af5314a7102589fb => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:33.373739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.456481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.469018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206b12c-9738-4a41-80ea-f4ed1dcec1c8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.494621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed797ac8-09c3-47dd-b673-3f3b2d5c2355 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.511508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.512449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.512832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.513204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.514009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:33.514422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:33.515947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:33.526495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 182/356] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:33.527521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.537934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1acf3c3-f3b0-4658-a071-4ab6ec6551dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.538910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf3c3-f3b0-4658-a071-4ab6ec6551dc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.539333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf3c3-f3b0-4658-a071-4ab6ec6551dc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.539798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1acf3c3-f3b0-4658-a071-4ab6ec6551dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.555190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1acf3c3-f3b0-4658-a071-4ab6ec6551dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b1acf3c3-f3b0-4658-a071-4ab6ec6551dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:33.562515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:33.563406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 25 02:47:33.564214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:33.565316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 175/357] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:33.569519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.569519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.569519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.572784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.593365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:33.594979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:33.670648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793abfc8-5109-4a3b-a833-46d800c75257 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.690512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 176/358] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:33.691166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.719502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.720148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.720431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.720708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.721603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=9fd606b05c854710af4411dd179e8f22) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:33.721921 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:33.723974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:33.731901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 183/359] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 260 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:33.733721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:33.770333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.836952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7d0e67-e8a9-431c-92f4-70948ee94c63 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.864673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:33.873514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111a7d5e-c9d2-436e-9407-051c148bf34e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:33.889757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.890418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.890703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.890977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.918910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:33.920880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.921533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.923280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.924272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:33.925048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:33.928072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f1421b-a97c-414f-a3b6-8367775f3192 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:33.943830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 184/360] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:33.947496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476cb6-1c30-4777-968d-518ed7713a83 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:33.948000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476cb6-1c30-4777-968d-518ed7713a83 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:33.948857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79476cb6-1c30-4777-968d-518ed7713a83 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:33.950586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 185/361] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:33.951536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79476cb6-1c30-4777-968d-518ed7713a83 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.029675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:34.030833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:34.069945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79476cb6-1c30-4777-968d-518ed7713a83 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.110877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9766c1f-4f48-406b-971d-81a1843ee51c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.111836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9766c1f-4f48-406b-971d-81a1843ee51c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.112337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9766c1f-4f48-406b-971d-81a1843ee51c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.112803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9766c1f-4f48-406b-971d-81a1843ee51c None admin] PATH_INFO: `/v3/users/08fd8d84954642208f89051c1d2fe8c1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.114215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9766c1f-4f48-406b-971d-81a1843ee51c None admin] RBAC: Authorizing `identity:get_user(user_id=08fd8d84954642208f89051c1d2fe8c1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:34.116611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9766c1f-4f48-406b-971d-81a1843ee51c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:34.118848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 186/362] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/users/08fd8d84954642208f89051c1d2fe8c1 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:34.120292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.120772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.121255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.140558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:34.142300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:34.143902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:34.157545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 177/363] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:34.158883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.176481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:34.258537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 187/364] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:34.260140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.301717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9973ac-cf9a-42ca-90aa-07b4f9f0e6ca None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.347530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.348719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.349205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.350179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.370484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:34.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:34.382968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:34.383880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:34.389024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 178/365] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:34.389976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.424833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:34.454591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03905d7-fd82-4427-8aa6-0812e4f7d049 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.499723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.503522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.503953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.504495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.505903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] RBAC: Adding query filter params (role.id=1466a2f6e2bf420e8c38bd277bd60ec6, user.id=08fd8d84954642208f89051c1d2fe8c1, scope.system=all) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:34.506576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:34.510144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:34.531128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 188/366] 10.222.0.72 () {56 vars in 1308 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/role_assignments?user.id=08fd8d84954642208f89051c1d2fe8c1&scope.system=all&role.id=1466a2f6e2bf420e8c38bd277bd60ec6 => generated 510 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:34.532174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.553567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:34.560691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3504f9-94e1-433a-8ebe-8698a4bb8b31 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.634689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.635699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.636155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.636573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.639383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:34.641270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:34.643699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 179/367] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:34.651375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.679452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6b516e-ca9f-4149-9b7b-f2f10cf3e922 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.760869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.761506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.761789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.762067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.762755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:34.763063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:34.764484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:34.776085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 189/368] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:34.776085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.807767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:34.840018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb813ce7-44a2-4fc9-8a9c-259017b3ee8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.888215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:34.892810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.893785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.894070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.894371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.897273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:34.898756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:34.901451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 180/369] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:34.901630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:34.928861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723c07dd-7add-4a39-b64a-e9f9168ff447 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:34.971354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:34.971999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:34.972309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:34.972585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:34.986699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:34.995034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:34.995941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:34.997024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 190/370] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:34.997660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:35.049601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146174e1-bc9b-4a99-8247-168cf0f762e1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:35.096690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:35.097303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.097586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:35.097860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:35.133475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:35.142209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c62c94-e593-4f58-8a1b-211704e6d351 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:35.185343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:35.185976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.186245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:35.186498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:35.187264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=bf081564133f4648af5314a7102589fb, scope.project.id=b1b5fbf9827e408993b276b5e99268e0) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:35.187574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:35.189161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:35.191305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:35.195173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:35.195872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 191/371] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=bf081564133f4648af5314a7102589fb => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:35.200246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:35.202193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:35.324171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973173ee-fe16-4fc6-b8c9-8d0b074011c3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:35.379971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:35.380675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.381100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:35.381378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:35.382209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:35.382546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:35.385025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:35.394690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 192/372] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:35.402601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:35.410002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 181/373] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:35.421304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:35.494949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:35.531952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c74c511-8d8c-482b-820b-aa3429b6d417 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:35.539144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:35.574089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:35.574929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.575375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:35.575805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:35.577081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:35.578700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:35.580630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 182/374] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:35 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:35.590755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:35.628083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195f6ec2-3dde-49e4-8bbb-cae668eec474 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:35.712761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dc5bce-fb14-4139-9d90-98b8df0fbfff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:35.713295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc5bce-fb14-4139-9d90-98b8df0fbfff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.713617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc5bce-fb14-4139-9d90-98b8df0fbfff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:35.713895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dc5bce-fb14-4139-9d90-98b8df0fbfff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:35.754533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d9648-9831-4a68-a209-65221e3dc6d9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:35.799444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:35.817458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc5bce-fb14-4139-9d90-98b8df0fbfff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:35.819785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dc5bce-fb14-4139-9d90-98b8df0fbfff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:35.830361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:35.831006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.831302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:35.831555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:35.832690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:35.835912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:35.838953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 183/375] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:35 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:35.846118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:35.924546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:35.998188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 193/376] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:35.999596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866e89e-c218-4764-8fb9-0bb3d90478fe None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:35.999884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866e89e-c218-4764-8fb9-0bb3d90478fe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.000208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a866e89e-c218-4764-8fb9-0bb3d90478fe None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.006133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 194/377] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:36.006965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866e89e-c218-4764-8fb9-0bb3d90478fe None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:36.018928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b75014-8d8f-4015-bc30-88641256a6bd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.061393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:36.062311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.062782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.063226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.064162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=b1b5fbf9827e408993b276b5e99268e0) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:36.064639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:36.066234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c14ea4f-68e7-4c2c-ac86-950300bdfca0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:36.073110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 184/378] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:35 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 260 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:36.074526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.074994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.075443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.095842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:36.097529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:36.158111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a866e89e-c218-4764-8fb9-0bb3d90478fe None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.177222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:36.207874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 185/379] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:36.223712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3e6114-2024-477d-ba9d-4f127d196abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:36.225531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e6114-2024-477d-ba9d-4f127d196abb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.225990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e6114-2024-477d-ba9d-4f127d196abb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.226503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3e6114-2024-477d-ba9d-4f127d196abb None admin] PATH_INFO: `/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.227859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e6114-2024-477d-ba9d-4f127d196abb None admin] RBAC: Authorizing `identity:get_project(project_id=35c83d4ef30f4517a1cc1f145e8660eb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:36.229598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3e6114-2024-477d-ba9d-4f127d196abb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:36.231823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 195/380] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:36 2022] GET /identity/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb => generated 344 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:36.237200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:36.291752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8504d-8d57-4d95-8970-2a5dcef04994 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.292069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8504d-8d57-4d95-8970-2a5dcef04994 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.292299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cc8504d-8d57-4d95-8970-2a5dcef04994 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.293771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 196/381] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:36.298710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.298985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.299252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.332077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:36.332077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:36.360591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:36.426590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788afe68-dadb-4de2-8221-ec9eca0ebf0d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.445767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 197/382] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:36.484776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:36.485418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.485698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.485972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] PATH_INFO: `/v3/groups/4dfc015d5a884075a0bab4d385478c8a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.492479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] RBAC: Authorizing `identity:get_group(group_id=4dfc015d5a884075a0bab4d385478c8a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:36.493925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:36.495870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 186/383] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:36 2022] GET /identity/v3/groups/4dfc015d5a884075a0bab4d385478c8a => generated 229 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:36.501421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:36.534696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:36.604224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:36.681463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b265bb6-9a14-4a6f-aac7-87642159fd43 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.688660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fecd4d4-8e6e-4721-bc90-161d048afb28 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.728647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:36.729270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.729544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.729824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.730560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] RBAC: Adding query filter params (group.id=4dfc015d5a884075a0bab4d385478c8a, role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=35c83d4ef30f4517a1cc1f145e8660eb) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:36.730868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:36.732375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:36.740563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 198/384] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:36 2022] GET /identity/v3/role_assignments?group.id=4dfc015d5a884075a0bab4d385478c8a&scope.project.id=35c83d4ef30f4517a1cc1f145e8660eb&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 260 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:36.742104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:36.742757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:36.743035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:36.743307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:36.766371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:36.772686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:36.773677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:36.774506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:36.778888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 187/385] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:36.780413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:36.799045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:36.836413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:36.965228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead3d9eb-6b3d-4b0c-8913-c79177d562fe None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.986258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3e5495-1e2b-4a28-bea7-73e83f25d844 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:36.998100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:37.012331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.013084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.013620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.013990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.015233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:37.015633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.017951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.029309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 199/386] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:37.031150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.031965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.032431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.032857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.034839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.046202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:37.054296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:37.055271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:37.056070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:37.063267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 188/387] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:36 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:37.063267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.149362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:37.168987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a28f83-54b5-4518-8442-d494eab32b44 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.191728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c8f660-7a2d-4a45-a393-a3cb9827cf9a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.219024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.220012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.220519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.221085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.222623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.225021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.227742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 200/388] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:37 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:37.232889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.235163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.236921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.237404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.238016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.239004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:37.239508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.241164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.256613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 189/389] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:37 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:37.262711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.323505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:37.410655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812cd2b7-1739-45c4-87f2-2de967b96515 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.473427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f476a8cf-f281-4360-a92e-d19113865cbb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.508767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.509414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.509818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.510187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.512943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.513093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.513574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.513853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.514127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.514430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.515232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.516531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 201/390] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:37 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:37.516770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.518953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 190/391] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:37 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:37.524987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.525157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.572702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:37.653365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:37.658012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573818bc-2d31-4bfc-8b63-e31c7d880ce5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.704436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.705317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.705595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.705919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.707987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.709656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.711616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 191/392] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:37 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:37.718147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:37.750349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94de1a4-4ed0-4e3f-acc5-5d3aff65a784 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.795304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3607c5c-915c-40f7-b0d1-3a079ec9ecba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.795979 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607c5c-915c-40f7-b0d1-3a079ec9ecba None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.796285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607c5c-915c-40f7-b0d1-3a079ec9ecba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.796558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3607c5c-915c-40f7-b0d1-3a079ec9ecba None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.800013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3607c5c-915c-40f7-b0d1-3a079ec9ecba None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd606b05c854710af4411dd179e8f22, group_id=e413a62ea8ff438489cb6eb578dc5efc, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.801731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3607c5c-915c-40f7-b0d1-3a079ec9ecba None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:37.826183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 202/393] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Aug 25 02:47:37 2022] PUT /identity/v3/projects/9fd606b05c854710af4411dd179e8f22/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:37.845573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335d7f7-89b1-4fd1-904c-52685eca7559 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.845916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335d7f7-89b1-4fd1-904c-52685eca7559 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.846097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6335d7f7-89b1-4fd1-904c-52685eca7559 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.847673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 203/394] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:37.858935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65726c-6062-40ae-9192-36815a83627c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.859271 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65726c-6062-40ae-9192-36815a83627c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.859458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be65726c-6062-40ae-9192-36815a83627c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.888468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-be65726c-6062-40ae-9192-36815a83627c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:37.891251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-be65726c-6062-40ae-9192-36815a83627c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:37.924674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e3f410-26e5-453c-a37c-62c62aa77f69 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:37.986762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:37.987447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:37.987729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:37.988007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:37.994249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] RBAC: Authorizing `identity:create_grant(project_id=9fd606b05c854710af4411dd179e8f22, group_id=e413a62ea8ff438489cb6eb578dc5efc, role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:37.995712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:38.019167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 192/395] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Aug 25 02:47:37 2022] PUT /identity/v3/projects/9fd606b05c854710af4411dd179e8f22/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:38.025721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 204/396] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:38.318240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:38.355248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:38.454354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae02d49-e77e-4f8e-87f8-1f1e4d6e80b7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:38.499573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:38.500241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:38.500520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:38.500789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:38.518235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:38.523860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:38.524795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:38.525610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 193/397] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:38.532415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65726c-6062-40ae-9192-36815a83627c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:38.544402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:38.663641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be65726c-6062-40ae-9192-36815a83627c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:38.714629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:38.715274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:38.715552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:38.715822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:38.716520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:38.716822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:38.718191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b2435b-3b95-4d64-a3bb-33a61b735967 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:38.727392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 205/398] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:38.733107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:38.857429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:38.878781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a28a3-2feb-407c-bbbd-4d87d3018a0e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:38.912100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64155e-83f1-4210-a556-2498e71cb14a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:38.912419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64155e-83f1-4210-a556-2498e71cb14a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:38.912700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f64155e-83f1-4210-a556-2498e71cb14a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:38.914097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 206/399] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:38.920114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:38.920508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:38.920793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:38.957106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:38.957753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:38.958028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:38.958334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:38.961580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:38.966165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:38.968811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:38.969993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:38.974962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 194/400] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:38 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:38.975854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:39.079790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 207/401] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:39.112890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906bc909-7c68-4fe2-81b6-5380d06bb5dd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:39.151076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:39.151717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:39.151994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:39.152302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:39.153470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:39.154899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:39.156707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 195/402] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:38 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:39.165167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:39.167987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:39.296235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb1584f5-1396-4f6c-b7f3-8e1bf243ba19 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:39.341939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f72bf4cd-9495-46ae-bea2-4aff604f91bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:39.342617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bf4cd-9495-46ae-bea2-4aff604f91bf None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:39.342894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bf4cd-9495-46ae-bea2-4aff604f91bf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:39.343168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f72bf4cd-9495-46ae-bea2-4aff604f91bf None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:39.349585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bf4cd-9495-46ae-bea2-4aff604f91bf None admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5fbf9827e408993b276b5e99268e0, group_id=e413a62ea8ff438489cb6eb578dc5efc, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:39.351027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f72bf4cd-9495-46ae-bea2-4aff604f91bf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:39.389327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 208/403] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Aug 25 02:47:39 2022] PUT /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:39.434722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:39.436805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ba67-3243-4b8f-9748-65c3d5aec854 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:39.437092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ba67-3243-4b8f-9748-65c3d5aec854 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:39.437367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4675ba67-3243-4b8f-9748-65c3d5aec854 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:39.438737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 209/404] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:39.445078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:39.445359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:39.445622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:39.464496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:39.465704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:39.474293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:39.537447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:39.551621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 210/405] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:39.607842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe27ce7b-76b7-44fa-b92b-676c260875c8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:39.653655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:39.654287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:39.654958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:39.655635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:39.670504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:39.675887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:39.676836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:39.678152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 196/406] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:39 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:39.685867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:39.797659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fc737-3245-4caf-9c45-04c4f0618feb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:39.833051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:39.834167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:39.834554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:39.835036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:39.835787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:39.836105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:39.837487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:39.846403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 211/407] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:39.852531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:39.956087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:39.973408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26e391f-99ac-4c8a-a1eb-7787ea716883 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:40.018577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:40.019229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.019511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.019789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.021035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:40.022578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:40.024354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 197/408] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:39 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:40.030015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:40.068654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:40.108430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:40.168290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b725e3-631d-476a-b783-bdcc7b7b98b6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:40.225365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:40.225916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.226192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.226464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.228005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:40.229650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:40.231754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 212/409] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:40 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:40.238311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:40.268991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0e044-fc09-4d32-add3-d072307a9574 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:40.313090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:40.314173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.314714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.315247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.343145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:40.355479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:40.356411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:40.357188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:40.362384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 198/410] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:40.366377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:40.394318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:40.452910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405844a8-136e-4bbb-8bdc-6b8be7db8b8a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:40.496586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:40.523087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcea3ab2-29d1-4beb-ae45-bb40a2ab582c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:40.524205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3ab2-29d1-4beb-ae45-bb40a2ab582c None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.524692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3ab2-29d1-4beb-ae45-bb40a2ab582c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.525173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcea3ab2-29d1-4beb-ae45-bb40a2ab582c None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.528088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3ab2-29d1-4beb-ae45-bb40a2ab582c None admin] RBAC: Authorizing `identity:create_grant(project_id=b1b5fbf9827e408993b276b5e99268e0, group_id=e413a62ea8ff438489cb6eb578dc5efc, role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:40.529773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcea3ab2-29d1-4beb-ae45-bb40a2ab582c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:40.566929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 213/411] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Aug 25 02:47:40 2022] PUT /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0/groups/e413a62ea8ff438489cb6eb578dc5efc/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:40.569762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a5e8-d8fb-44ef-a13d-b82ce6487d98 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.570279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a5e8-d8fb-44ef-a13d-b82ce6487d98 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.570743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4a5e8-d8fb-44ef-a13d-b82ce6487d98 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.572311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 214/412] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:40.573931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c132b7-6ac0-425f-8166-e0d54a622f21 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:40.593789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc8aa-9e1f-4291-9b3a-6c671567f827 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.594434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc8aa-9e1f-4291-9b3a-6c671567f827 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.594903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445fc8aa-9e1f-4291-9b3a-6c671567f827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.629232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-445fc8aa-9e1f-4291-9b3a-6c671567f827 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:40.632705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-445fc8aa-9e1f-4291-9b3a-6c671567f827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:40.650305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:40.651347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.651822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.652308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.653497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:40.654261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:40.658885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3664db-b7b7-4e8d-a64d-8754bcf3f70f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:40.679097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 199/413] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:40.683516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ce730-2f33-4e99-9d76-311dc9151748 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.684324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ce730-2f33-4e99-9d76-311dc9151748 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.685877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925ce730-2f33-4e99-9d76-311dc9151748 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.687518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 200/414] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:40.690324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ce730-2f33-4e99-9d76-311dc9151748 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:40.762539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 215/415] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:40.764663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.765475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.765991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.791933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:40.795214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:40.811808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:40.892092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925ce730-2f33-4e99-9d76-311dc9151748 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:40.917099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 216/416] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:40.974938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:40.975581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:40.975860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:40.976181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] PATH_INFO: `/v3/groups/4dfc015d5a884075a0bab4d385478c8a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:40.980707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] RBAC: Authorizing `identity:get_group(group_id=4dfc015d5a884075a0bab4d385478c8a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:40.982151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:40.983906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 201/417] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:40 2022] GET /identity/v3/groups/4dfc015d5a884075a0bab4d385478c8a => generated 229 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:40.989387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.085666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:41.123898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.155667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcec2945-8021-4064-b2e6-4fbd033a5380 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.195412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.196067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.196416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.196691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] PATH_INFO: `/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.197817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] RBAC: Authorizing `identity:get_project(project_id=35c83d4ef30f4517a1cc1f145e8660eb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:41.199251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:41.201236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 217/418] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:40 2022] GET /identity/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb => generated 344 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:41.207250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.338977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-903cf2fe-fd23-4ebf-b555-b2b868ada388 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.366721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db60a82a-e087-4775-80d6-2ee504c05569 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.374977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.375607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.375888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.376200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.381284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:41.386453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:41.389435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:41.395277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:41.397127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 202/419] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:41.398025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.418223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.419236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.419707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.420250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] PATH_INFO: `/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb/groups/4dfc015d5a884075a0bab4d385478c8a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.422481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=35c83d4ef30f4517a1cc1f145e8660eb, group_id=4dfc015d5a884075a0bab4d385478c8a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:41.424269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:41.442625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 218/420] 10.222.0.72 () {58 vars in 1442 bytes} [Thu Aug 25 02:47:41 2022] PUT /identity/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb/groups/4dfc015d5a884075a0bab4d385478c8a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:47:41.445139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.535200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833d2f2b-79cb-43c9-a000-eaf58e0a8e51 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.571512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b56835-1261-4aed-aef6-cf928b3035e8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.574131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.575244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.575740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.576231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.588217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:41.594031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:41.594915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:41.595706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:41.598076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 203/421] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:41.604739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.609240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.610589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.610589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.610589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.611112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:41.611468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:41.612948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:41.623838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 219/422] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:41.637788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.685843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:41.732679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbf773d-6d86-4eb7-ab1e-58cd716ea4ff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.735910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:41.779155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.779966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.780328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.780825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.781566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:41.781872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:41.783270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:41.793505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 204/423] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:41.799654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:41.919257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79962ec7-0da1-45dc-8f7f-375d1fee81a9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.948917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e613e74-62cf-406b-a744-c1393739050e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:41.949344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:41.966684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270b7d1e-036e-4dad-a745-410226d4bfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.967769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b7d1e-036e-4dad-a745-410226d4bfba None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.968573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b7d1e-036e-4dad-a745-410226d4bfba None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.969067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b7d1e-036e-4dad-a745-410226d4bfba None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:41.985917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f41e74-ac39-411e-bb67-72394c778e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:41.986533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f41e74-ac39-411e-bb67-72394c778e07 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:41.986816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f41e74-ac39-411e-bb67-72394c778e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:41.987091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f41e74-ac39-411e-bb67-72394c778e07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.060925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b7d1e-036e-4dad-a745-410226d4bfba None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.061392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f41e74-ac39-411e-bb67-72394c778e07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.062869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f41e74-ac39-411e-bb67-72394c778e07 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.063195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270b7d1e-036e-4dad-a745-410226d4bfba None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.097775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:42.180325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 220/424] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:42.181606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922efcb-0101-412d-a3ee-f7e843d45398 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.181893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922efcb-0101-412d-a3ee-f7e843d45398 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.182173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d922efcb-0101-412d-a3ee-f7e843d45398 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.187866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 221/425] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:42.188682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922efcb-0101-412d-a3ee-f7e843d45398 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.198830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 205/426] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:47:42.200697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.200986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.201260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.232625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:42.234341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:42.257464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:42.319472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d922efcb-0101-412d-a3ee-f7e843d45398 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.328127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 206/427] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:42.328127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.382834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:42.397435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:42.398171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.398508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.398790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.402345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.404023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.406128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 222/428] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:42.411177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.443031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6595ea95-d536-493e-8f6f-74e40ac7af6d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.496009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:42.497956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.498237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.499312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] PATH_INFO: `/v3/projects/9fd606b05c854710af4411dd179e8f22` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.503131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] RBAC: Authorizing `identity:get_project(project_id=9fd606b05c854710af4411dd179e8f22)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.506701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.508407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 207/429] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/projects/9fd606b05c854710af4411dd179e8f22 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:42.514187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.556613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:42.595900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f56e0f-e38f-4763-8276-7493f896c5a8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.648285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:42.649265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.649548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.649823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.651754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.653239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.660180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 223/430] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:42.661008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.707246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0ad74b-0bb6-4887-b052-cba49661c5e9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.751249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:42.752007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.752319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.752588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.753781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.756108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.759455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 208/431] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:42.759455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.760960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:42.797537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f13fcc6-d70d-4c14-9d46-ba10bd4059b6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.832113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:42.832720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.832990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.833864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.834690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=bf081564133f4648af5314a7102589fb, scope.project.id=9fd606b05c854710af4411dd179e8f22) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:42.834998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:42.836456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3fb93c-42fe-4bd5-8e99-6aa5dfc6c182 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:42.842663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 224/432] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=bf081564133f4648af5314a7102589fb => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:42.843855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd9cc-3b02-436e-b9fc-b58ffd8ac905 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.844167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd9cc-3b02-436e-b9fc-b58ffd8ac905 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.844443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31dd9cc-3b02-436e-b9fc-b58ffd8ac905 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.845672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 225/433] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:42.846447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dd9cc-3b02-436e-b9fc-b58ffd8ac905 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:42.881184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:42.902129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7695bf-b28c-48d6-8195-ee0874932180 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.953464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d2c441-9c36-42c8-a645-0948efba0bb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:42.954877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c441-9c36-42c8-a645-0948efba0bb6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.955360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c441-9c36-42c8-a645-0948efba0bb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.955829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d2c441-9c36-42c8-a645-0948efba0bb6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:42.972969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31dd9cc-3b02-436e-b9fc-b58ffd8ac905 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:42.974288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d2c441-9c36-42c8-a645-0948efba0bb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-20d2c441-9c36-42c8-a645-0948efba0bb6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:42.981666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:42.982637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 25 02:47:42.983407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:42.987796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 209/434] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:42.989055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:42.989473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:42.990636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.012296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:43.013614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:43.014652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:43.022420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.023477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.023758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.024030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.025152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=9fd606b05c854710af4411dd179e8f22) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:43.025465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:43.027213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:43.036011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 226/435] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:42 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=9fd606b05c854710af4411dd179e8f22&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 611 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:43.036906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.119089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 210/436] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:43.173301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ced3d-35ff-4fb9-b6ec-fce37f492b9e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.211428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.212073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.212353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.212627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.213309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] RBAC: Adding query filter params (name=member) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:43.213611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:43.215048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:43.225186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 227/437] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:43.230852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.316351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:43.341983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0ce695-bf27-469f-b93e-edbf59fc075d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.382828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.383439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.383715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.383987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.410611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.465771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:43.466747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:43.495852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:43.557785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d7a86-a0e2-4317-afc3-45b2e3e9842a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.562815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:43.592887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 211/438] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:43.600730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.612187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5884c-4389-4241-96cb-68888eb8eb86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.613062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5884c-4389-4241-96cb-68888eb8eb86 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.613611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5884c-4389-4241-96cb-68888eb8eb86 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.613885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5884c-4389-4241-96cb-68888eb8eb86 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.628749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5884c-4389-4241-96cb-68888eb8eb86 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7ab5884c-4389-4241-96cb-68888eb8eb86 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:43.634993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:43.636023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:43.637062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 228/439] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:43.638783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43b94-e392-4b57-ab56-a6674b874f1a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.638783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43b94-e392-4b57-ab56-a6674b874f1a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.638783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a43b94-e392-4b57-ab56-a6674b874f1a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.640366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 229/440] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:43.643027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a43b94-e392-4b57-ab56-a6674b874f1a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.722291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d80084-f1af-4883-bfaa-5e6bc706bb05 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.760715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3325545c-6d63-4432-ae8d-34cc69137e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.761262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325545c-6d63-4432-ae8d-34cc69137e17 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.761539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325545c-6d63-4432-ae8d-34cc69137e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.761810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3325545c-6d63-4432-ae8d-34cc69137e17 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.762555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a43b94-e392-4b57-ab56-a6674b874f1a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.762903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325545c-6d63-4432-ae8d-34cc69137e17 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:43.764402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3325545c-6d63-4432-ae8d-34cc69137e17 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:43.766015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 212/441] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:43.767497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.767775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.768074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.787254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:43.788655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:43.790235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:43.810173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.810771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.811046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.811314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.811974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:43.812325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:43.813704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:43.823368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 230/442] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:43.824160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.837127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:43.860774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 213/443] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:43.861604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:43.929062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f378d74a-fd29-4013-a4d9-71dff4ba7d81 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.972357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f16e393-fa41-43bc-be3a-a44c5eae345e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:43.972796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:43.973487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:43.974122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:43.974429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:43.976441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:43.977898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:43.979651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 231/444] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:43.985177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.009945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.010658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.010990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.011213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.034092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.060476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.086420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.086609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ee76-e466-4a71-ba93-c8897aaa718c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.088072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.120743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.121346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.121621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.121890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.122613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=bf081564133f4648af5314a7102589fb, scope.project.id=b1b5fbf9827e408993b276b5e99268e0) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:44.122917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.124439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.130865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 232/445] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=bf081564133f4648af5314a7102589fb => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:44.133894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.215199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 214/446] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:44.216438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.250614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee92234-ffa9-413f-9e71-2f570067afcd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.265697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.292207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.294609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.294609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.294609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.304982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:44.307767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:44.310956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:44.312147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:47:44.313174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:44.315203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 233/447] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:44.322053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.335612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ac6f3f-c710-49e9-8ab0-7e071a20d260 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.374907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.375534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.375812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.376122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] PATH_INFO: `/v3/projects/b1b5fbf9827e408993b276b5e99268e0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.377251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] RBAC: Authorizing `identity:get_project(project_id=b1b5fbf9827e408993b276b5e99268e0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.378683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.380374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 215/448] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/projects/b1b5fbf9827e408993b276b5e99268e0 => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:44.386820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.441992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1bc8935-5c83-4fd8-9588-1d6fad379885 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.483964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.484693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.485071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.485176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.485825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:44.486126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.487499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.497430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 234/449] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:44.502683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00333cb9-4f49-4198-a5a2-a56e9365a912 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.502966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.536673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.536894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.537320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.537609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.537878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] PATH_INFO: `/v3/groups/e413a62ea8ff438489cb6eb578dc5efc` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.539015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] RBAC: Authorizing `identity:get_group(group_id=e413a62ea8ff438489cb6eb578dc5efc)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.540531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.542094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 216/450] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/groups/e413a62ea8ff438489cb6eb578dc5efc => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:44.547855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.562855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.602828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54666d7-a4a3-4b41-9b1a-bd4e5778dc77 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.636938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.637532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.637812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.638083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.647951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b7573d6-ac6e-4635-8e27-ca41a5a0fab1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.681766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.682352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.682627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.682900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.683612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] RBAC: Adding query filter params (group.id=e413a62ea8ff438489cb6eb578dc5efc, role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=b1b5fbf9827e408993b276b5e99268e0) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:44.683917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.685361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.691251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 217/451] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/role_assignments?group.id=e413a62ea8ff438489cb6eb578dc5efc&scope.project.id=b1b5fbf9827e408993b276b5e99268e0&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:44.707693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.710227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.746759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.816577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 235/452] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:47:44.822479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:44.903647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:44.926743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194ca579-b630-48f0-bcea-488e990ee40c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:44.964614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:44.965245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:44.965522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:44.965795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] PATH_INFO: `/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:44.966912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] RBAC: Authorizing `identity:get_project(project_id=35c83d4ef30f4517a1cc1f145e8660eb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:44.968443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:44.970077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 218/453] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/projects/35c83d4ef30f4517a1cc1f145e8660eb => generated 344 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:44.976213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:45.074170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd930c50-b41e-4986-8abd-6c5c56280f5a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:45.106704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1d2531-7608-4079-9676-f95ebecbf8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:45.107316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2531-7608-4079-9676-f95ebecbf8aa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:45.107588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2531-7608-4079-9676-f95ebecbf8aa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:45.107855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1d2531-7608-4079-9676-f95ebecbf8aa None admin] PATH_INFO: `/v3/groups/4dfc015d5a884075a0bab4d385478c8a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:45.108963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d2531-7608-4079-9676-f95ebecbf8aa None admin] RBAC: Authorizing `identity:get_group(group_id=4dfc015d5a884075a0bab4d385478c8a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:45.110390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1d2531-7608-4079-9676-f95ebecbf8aa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:45.111934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 236/454] 10.222.0.72 () {56 vars in 1180 bytes} [Thu Aug 25 02:47:44 2022] GET /identity/v3/groups/4dfc015d5a884075a0bab4d385478c8a => generated 229 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:45.118103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:45.214206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfdb66d-53fe-4195-8a46-1350ad02317a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:45.246131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:45.246705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:45.246980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:45.247248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:45.247964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] RBAC: Adding query filter params (group.id=4dfc015d5a884075a0bab4d385478c8a, role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=35c83d4ef30f4517a1cc1f145e8660eb) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:45.248294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:45.249720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28dcb0a7-79cb-4e4c-b357-a5fa4aee52e1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:45.255306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 219/455] 10.222.0.72 () {56 vars in 1376 bytes} [Thu Aug 25 02:47:45 2022] GET /identity/v3/role_assignments?group.id=4dfc015d5a884075a0bab4d385478c8a&scope.project.id=35c83d4ef30f4517a1cc1f145e8660eb&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 611 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:47.508283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49ea02-c78c-408c-8206-0f3d63df34de None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:47.509111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49ea02-c78c-408c-8206-0f3d63df34de None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:47.509548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b49ea02-c78c-408c-8206-0f3d63df34de None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:47.511245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 237/456] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:47.516904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3e42-aeeb-4e15-b590-c9597d73d8f2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:47.517602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3e42-aeeb-4e15-b590-c9597d73d8f2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:47.517716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fa3e42-aeeb-4e15-b590-c9597d73d8f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:47.541034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-71fa3e42-aeeb-4e15-b590-c9597d73d8f2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:47.542462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71fa3e42-aeeb-4e15-b590-c9597d73d8f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:47.547770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:47.639870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 220/457] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:47.888829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42dee-eb58-47ab-9fc0-75ff4e0a8143 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:47.889532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42dee-eb58-47ab-9fc0-75ff4e0a8143 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:47.890032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab42dee-eb58-47ab-9fc0-75ff4e0a8143 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:47.891815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 238/458] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:47.897153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:47.897661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:47.898126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:47.920981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:47.922451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:47.937456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824097f6-0fc3-4950-a9d8-32312964fd35 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:47.937739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824097f6-0fc3-4950-a9d8-32312964fd35 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:47.938010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824097f6-0fc3-4950-a9d8-32312964fd35 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:47.939621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 239/459] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:47.946275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b236-9043-4651-a3f5-4be9daad891d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:47.946510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b236-9043-4651-a3f5-4be9daad891d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:47.947150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9b236-9043-4651-a3f5-4be9daad891d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:47.972390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:47.984770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f9a9b236-9043-4651-a3f5-4be9daad891d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:47.985986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f9a9b236-9043-4651-a3f5-4be9daad891d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:48.032999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 221/460] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:48.068316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.097343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 240/461] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:48.139715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:48.180728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50759384-444a-48f5-8cff-8d51aebd5835 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:48.232793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:48.233725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.234190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.234638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.250094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:48.251818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:48.256304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a7a73-05bf-45d7-97a2-1d96b48901a8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.256744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a7a73-05bf-45d7-97a2-1d96b48901a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.262352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65a7a73-05bf-45d7-97a2-1d96b48901a8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.263188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 241/462] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:48 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:48.271483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:48.272409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:48.273309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:48.274136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:48.274136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:48.274136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:48.274992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.275377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.276217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 222/463] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:48.284829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.301092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:48.303194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:48.424218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253ef15a-8edb-4de1-b795-b342da6e3cd4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:48.425360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 242/464] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:48.427857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.450069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:48.479582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:48.480216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.480497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.480770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.484347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:48.484656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:48.486031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:48.507876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 223/465] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:48.508764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.526768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:48.568996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def968a2-507c-468f-a6be-8b404bf6404d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:48.607442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:48.608089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.608373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.608641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.619917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:48.621457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:48.624325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3f9afd-7d63-45c2-83f0-49b375359803 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:48.638955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:48.639853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:48.641300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:48.641300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:48.641300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:48.641300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 243/466] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:48.641300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.671119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:48.671732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.672008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.672309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.697070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:48.698445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:48.725731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:48.726688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:48.727998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:48.727998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:48.727998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:48.727998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 224/467] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:48.727998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.762433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10bb6aa-fe6e-4adb-904e-beab7a5fc8c5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:48.764200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:48.778316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:48.800422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:48.801034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.801311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.801572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.802938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:48.804398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:48.836078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 244/468] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:48 2022] POST /identity/v3/users => generated 246 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:48.836078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.852194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020376ed-e8c1-478b-b838-03a1e3a7f257 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:48.894620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:48.895391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:48.895860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:48.896242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:48.897197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:48.897588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:48.899274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:48.914407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 225/469] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:48.915280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:48.985095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c03c77c-56ca-497f-963e-3f45c8579aa8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:49.039997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:49.040715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.040993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.041260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.042100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:49.042406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:49.044226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:49.054637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:49.057518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 245/470] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:49.058602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:49.064028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6230cb-3e94-4960-a623-70857477a0e4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:49.095261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:49.110397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:49.112753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.113044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.113318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.129021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:49.131188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:49.149718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:49.150609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:49.151836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:49.151836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:49.151836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:49.151836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 226/471] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:49.152069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:49.198235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1b0f2d-a235-47a1-9473-20d8cb8f74c5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:49.241383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:49.241999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.242280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.242546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.243186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:49.244746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:49.268116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f18611-198f-4487-a765-32d7a07bf654 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:49.270115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 246/472] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:49 2022] POST /identity/v3/users => generated 248 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:49.272144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:49.310740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb26455e-62b0-4ec1-83d2-b5016ea1f9a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:49.311368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26455e-62b0-4ec1-83d2-b5016ea1f9a0 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.311849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26455e-62b0-4ec1-83d2-b5016ea1f9a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.312197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb26455e-62b0-4ec1-83d2-b5016ea1f9a0 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.313120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26455e-62b0-4ec1-83d2-b5016ea1f9a0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:49.314702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb26455e-62b0-4ec1-83d2-b5016ea1f9a0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:49.353416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:49.362687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 227/473] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:49 2022] POST /identity/v3/users => generated 248 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:49.391430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:49.416952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a2174d-4ec8-4aef-971b-99bd9fb3632e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:49.463621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:49.464268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.464548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.464822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.465481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:49.465784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:49.467189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:49.481155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 247/474] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:49.485653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143138e3-7cff-457e-97b9-a0dfb7df5b44 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.486028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143138e3-7cff-457e-97b9-a0dfb7df5b44 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.486381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143138e3-7cff-457e-97b9-a0dfb7df5b44 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.488107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 228/475] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:49.491251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:49.494020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.494252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.494526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.517294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:49.518799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:49.608876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 229/476] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:49.621559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74574ac-812e-4f1d-aab1-6448b0579c20 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:49.660699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:49.661973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:49.662355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:49.662727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:49.663505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:49.665108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:49.690665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 248/477] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:49 2022] POST /identity/v3/users => generated 249 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:49.913495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:50.020118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077b664e-e22b-4160-9286-ad9969fa28ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:50.052577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:50.057817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:50.058435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:50.058716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:50.059011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:50.059681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:50.061088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:50.070328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.sql.core [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 02:47:50.070328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 02:47:50.070328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [parameters: {'id': '41f69c31e0d14e6388a88e8c07e81009', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 02:47:50.070328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81632) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Aug 25 02:47:50.087324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return ref.to_dict() Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:47:50.088248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application yield resource Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise self.value Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application session.commit() Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 02:47:50.089111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.flush() Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application compat.raise_( Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 02:47:50.089936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:47:50.090885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:47:50.091662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [parameters: {'id': '41f69c31e0d14e6388a88e8c07e81009', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:50.092471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 25 02:47:50.093312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:50.094135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 230/478] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Aug 25 02:47:49 2022] POST /identity/v3/roles => generated 144 bytes in 176 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:50.101197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:50.104272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:50.213866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc36e97-8bc6-468c-98a4-3bfc44f0f6ee None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:50.249616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e47882-3f8a-440f-bfee-f2f3ae8c4a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:50.250249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e47882-3f8a-440f-bfee-f2f3ae8c4a58 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:50.250531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e47882-3f8a-440f-bfee-f2f3ae8c4a58 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:50.250805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e47882-3f8a-440f-bfee-f2f3ae8c4a58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:50.263090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e47882-3f8a-440f-bfee-f2f3ae8c4a58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-16e47882-3f8a-440f-bfee-f2f3ae8c4a58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:50.268594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:50.269454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:50.270244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 249/479] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:47:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:50.276395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:50.384573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d3377-ce72-4b0c-b0ea-40b27440ebc3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:50.419970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:50.420636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:50.420892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:50.421167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:50.421838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:50.422142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:50.423511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-718f2aac-a58b-4f96-b38d-ffed8d1ea5d1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:50.433055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 231/480] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:51.047188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7117d-d2e1-40d0-9cba-453d90be0878 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:51.047684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7117d-d2e1-40d0-9cba-453d90be0878 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:51.047786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7117d-d2e1-40d0-9cba-453d90be0878 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:51.049368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 250/481] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:51.054390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:51.055186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:51.055660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:51.085012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:51.086532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:51.153932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:51.178892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 232/482] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:51.461035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7117d-d2e1-40d0-9cba-453d90be0878 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:51.540458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:51.597635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7117d-d2e1-40d0-9cba-453d90be0878 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:51.645007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:51.645766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:51.646043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:51.646491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:51.664899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:51.669614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:51.670471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:51.671254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 251/483] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:51.677633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:51.812852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-664fd80a-5b7a-425c-a618-3bd5da322f37 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:51.865899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:51.866506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:51.866785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:51.867055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:51.867718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:51.868014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:51.869393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c73109d-7708-4d56-921b-8726a3455f2e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:51.883787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 233/484] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:47:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:51.891610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:51.907896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e0a8-a3fe-4cc5-b236-473f9df10bbc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:51.908210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e0a8-a3fe-4cc5-b236-473f9df10bbc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:51.908472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3312e0a8-a3fe-4cc5-b236-473f9df10bbc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:51.909834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 234/485] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:51.915851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53754e70-351e-4681-b108-12a9c7e2aa06 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:51.916154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53754e70-351e-4681-b108-12a9c7e2aa06 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:51.916423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53754e70-351e-4681-b108-12a9c7e2aa06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:51.953717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-53754e70-351e-4681-b108-12a9c7e2aa06 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:51.954907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-53754e70-351e-4681-b108-12a9c7e2aa06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:52.009534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:52.036544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 235/486] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:52.038204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf99c-89fe-4e67-b96f-65d1faec7c27 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.038654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf99c-89fe-4e67-b96f-65d1faec7c27 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.039093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24acf99c-89fe-4e67-b96f-65d1faec7c27 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.040778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 236/487] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:52.047143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d939-da93-4c56-b9b6-88003bd567f7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.047837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d939-da93-4c56-b9b6-88003bd567f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.049456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d9d939-da93-4c56-b9b6-88003bd567f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.062965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1c865e-599b-4f40-92df-2b58cf5ece19 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.085707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d4d9d939-da93-4c56-b9b6-88003bd567f7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:52.088282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4d9d939-da93-4c56-b9b6-88003bd567f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:52.107984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:52.130388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.132800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.133091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.133374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.152406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:52.154322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:52.179788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:52.180822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:52.181656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:52.181656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:52.181656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:52.183778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 252/488] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:52.193472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.242474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 237/489] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:52.348477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0981920-468e-4acd-a5d1-63cdd0336dc7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.404751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.405363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.405643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.405924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.406580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:52.406882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:52.408296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-512a789f-3793-4ff0-b09d-34caa60536d7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:52.413600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd05b4-36d1-416b-bb15-464a8ae8e241 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.413886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd05b4-36d1-416b-bb15-464a8ae8e241 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.414161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fd05b4-36d1-416b-bb15-464a8ae8e241 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.416862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 238/490] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:52.417584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd05b4-36d1-416b-bb15-464a8ae8e241 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.422289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 253/491] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:52.425715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.426178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.426654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.449016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:52.450314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:52.479461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:52.534054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 254/492] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:47:52.534054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.564420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fd05b4-36d1-416b-bb15-464a8ae8e241 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.576912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:52.609128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.609671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.609946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.610214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.623564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:52.629444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:52.631307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 239/493] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:52.632764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.655056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2483a3-b521-4d99-9ff2-dc32bc0d7367 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.700743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.701376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.701648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.701928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.712514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:52.714202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:47:52.731754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:52.732735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:52.733646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 255/494] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/users/nova => generated 82 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:52.734247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.757817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-278f9fec-420b-4a89-a71c-d0c8f8558282 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.766923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:52.797621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.798627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.799182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.799652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.811499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:52.817712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:52.818989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:52.819776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:52.822159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 240/495] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:52.823154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.855641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:52.861692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc8b084-1c82-4be3-bcdf-9a3de34bf0d3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.899836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.900470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.900746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.901012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.901679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:52.901976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:52.903559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:52.916285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 256/496] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:52.916285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:52.945421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b2cb9a-0dc4-43fa-b9cf-d05b81f2c505 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:52.985445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:52.986051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:52.986331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:52.986604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:52.987336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:52.987642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:52.989689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.014179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.028293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 241/497] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:53.029139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.036763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26730f6-a198-4a4b-93a2-c8ab8aedee33 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.075103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.076463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.076913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.077403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.088670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:53.094557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:53.095386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:53.096603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:53.097360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 257/498] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:53.098142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.122751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.141448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95bd221-d4df-4cc5-8b06-ef2fdb0d1238 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.178649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.179258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.179542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.179817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.180521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:53.180826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.182202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.190710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 242/499] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:53.191517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.206485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b601432e-3cbe-486a-a4ce-b1beada5e919 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.242557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.243181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.243466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.243740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.255664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.257353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.263574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:53.273645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:53.274519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:53.275338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:53.275338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.275338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:53.275338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 258/500] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:53.275555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.293394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e67ce0b-e108-44a6-9e41-a37eab9e9146 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.326677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.327274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.327556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.327829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.346166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.376910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633fd353-97b7-46b7-90b5-e6d051a822bf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.398447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.399911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.412018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.412645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.412925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.413200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.413870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:53.414171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.415538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aafa1bf-d14c-48b3-a546-422b485a28b3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.423381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 259/501] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:53.424554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94ff7-e79f-481a-8baf-31d7a22266e6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.424837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94ff7-e79f-481a-8baf-31d7a22266e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.425114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad94ff7-e79f-481a-8baf-31d7a22266e6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.426495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 260/502] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:53.427382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94ff7-e79f-481a-8baf-31d7a22266e6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.491233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.498052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 243/503] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:53.498876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.536032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad94ff7-e79f-481a-8baf-31d7a22266e6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.552903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.570005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.570628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.570917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.571191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.581408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.583471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-42d1ed7c-b7bf-466c-9488-df7a2c454b27 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:53.597514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:53.598645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:53.599490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:53.599490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.599490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:53.599490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 261/504] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:53.600054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.600341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.600614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.609126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b82e31-f64f-4bfa-aba4-36f199355dc6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.618782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:53.619994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:53.642758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.643286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.643559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.643827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.644488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:53.644793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.646184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.657558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 244/505] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:53.658337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.689471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 262/506] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:53.690317 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.744985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.763291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac0e119d-cab4-41cc-8ee5-f025b95ea80f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.773418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.799442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.800089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.800378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.800661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.809035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501dedc-28a2-4d18-a7dd-be53ba5693b3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.811673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.813168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:53.828441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:53.829421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:53.830244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:53.830244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.830244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:53.830244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 245/507] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:53.830463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.850436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.851069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.851346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.851617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.862963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.865083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:53.880597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:53.881475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:53.882319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:53.882319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:53.882319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:53.882319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 263/508] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:53.882527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:53.957471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea28d905-ae54-4e7e-a9a3-8dea19f6f81d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.989909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:53.994537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:53.995136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:53.995413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:53.995684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:53.996365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:53.996666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:53.997153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4d4d23-b535-45b8-bc55-d75a7e5039fb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:53.998046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.010132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 246/509] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.010861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.029783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.030403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.030674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.030944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] PATH_INFO: `/v3/users/glance` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.033784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.039336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.040831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:47:54.052898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:54.053938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:54.054826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 264/510] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:54.055360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.114597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed498a91-1a60-4855-bb0e-c622242b4555 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.148180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.148785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.149052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.149324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.149982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:54.150271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.151644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.154843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b611dfca-db2e-457a-88d8-511273c16aea None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.163893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 247/511] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.164723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.193617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.194149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.194423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.194695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.195329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:54.195629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.197014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.208970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 265/512] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.209748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.224868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.248020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.267363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edaeb8e7-9733-4db8-b80c-8f50b57211ec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.300494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.301116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.301416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.302388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.311938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cefb315b-eff3-4e63-927c-cb0cbdac5599 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.313043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.314482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:54.328730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:54.329831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:54.330856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:54.330856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:54.330856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:54.334761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 248/513] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:54.335467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.345174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.345798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.346075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.346341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.354035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.355461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:47:54.367145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:54.368426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 266/514] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/users/cinder => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:54.370173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.437321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097eb864-2c93-4717-bc52-fb229dafca60 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.443856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.466118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.468356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943d8b31-2fbd-4218-ac39-9a27529f6399 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.471365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.471955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.472260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.472530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.473355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:54.474290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.475721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.492728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 249/515] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.493529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.505858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.506473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.506749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.507021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.514345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.515767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:47:54.527857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:54.528764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:54.529609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 267/516] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:54.530149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.590692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b25438e-254f-48c9-8cb2-d48b56fc10a6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.624969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.625587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.625865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.626136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.631344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d84bae-cb82-4c0c-828d-11cdc8ba013e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.633162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.634590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:47:54.646522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:54.647494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 250/517] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:54.653128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.666146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.666754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.667032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.667309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.667950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:54.668283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.669647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.671038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.684129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 268/518] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.684924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.702823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.753327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa2817b-115b-48e1-ae2e-9bf50e1543a6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.785679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70293b64-0041-4c7b-ab49-8dfea252bb52 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.786670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.787349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.787694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.787971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.788732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:54.789039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.790483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.807672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 251/519] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.808499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:54.827617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.828246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.828524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.828789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.887911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.895929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.897928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.909135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c510d3-2fa6-4d54-9c40-0bfb8cf0f2fb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:54.918607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:54.944465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:54.945073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:54.945353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:54.945629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:54.946362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:54.946666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:54.948114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:54.965899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 252/520] 10.222.0.72 () {56 vars in 1139 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:54.966638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.002108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 269/521] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:55.002928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.067373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2592c850-a37a-4f82-a6fe-de4c5c184453 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.094933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.101504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.102100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.102333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72b5a40-12e5-4016-91e3-0a9f2bd5b209 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.102426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.102629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.103310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:55.103607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.105058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.122809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 253/522] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:47:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:55.123615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.145897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.146574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.146852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.147119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.147742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.149206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.151008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.171424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 270/523] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:47:55 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:47:55.172350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.232167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f1bd27-14b9-44dc-aeb9-b2447128d98a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.269202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.269823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.270103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.271049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.291620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9303396f-68a3-4079-b1aa-0223680ea585 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.333822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.334526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.334801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.335070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.353895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.355980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.362585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.387856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.415965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.417755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.475025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 254/524] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:55.475906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.530671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 271/525] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:55.531427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.585886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c383890-9559-4627-b1bd-460fb7b6ca82 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.587101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.612988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.623597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.624305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.624617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.624856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.635921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.637504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.641344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d415df8-47d3-4da5-a29f-b3f5d7045abc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:55.653644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:55.654543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:55.656488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:55.656488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:55.656488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:55.656488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 255/526] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:55.656488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.683204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.683816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.684115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.684396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.685169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=a4e5a17f91134c59bec66f04a175ef05) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:55.685440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.686844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.700093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 272/527] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/role_assignments?user.id=a4e5a17f91134c59bec66f04a175ef05&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:55.700093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.791950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20829d8-02ba-4b97-8b65-c83e11b0ff51 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.832490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.834190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.834585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.834969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.847467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.847916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbb11b2-8b54-4b3a-bcca-0c96a05b2353 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:55.849796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:55.867723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:55.868728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:55.869555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:55.869555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:55.869555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:55.869728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.869797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 256/528] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:55.870286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:55.899911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:55.900848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:55.901128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:55.901401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:55.908165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:55.919673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:55.921278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:55.939254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:55.940284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:55.941140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:55.941140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:55.941140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:55.941140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 273/529] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:55.941609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.006473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcb7d31-b769-4eaa-b8bf-41a25e9e9b9a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.041676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.042327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.042548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.042818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.043454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.043751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.045148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.059200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 257/530] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.060167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.081395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2acd63-de0c-4db4-9521-f95e10825ef0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.117270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.117823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.118103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.118374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.119128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.119431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.120931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.138444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 274/531] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.138444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.173221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.185798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.199919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fd900e-8a91-48ae-b5e6-08d12564381d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.243044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.243649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.243926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.244238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.244884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.245185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.246556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.260191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 258/532] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.261133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.281871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bb6e25-52b9-4305-b2d3-08289522b050 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.335660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.336328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.336607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.336909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.346087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.348091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:47:56.366970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:56.367853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:56.368735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:56.369158 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 275/533] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:56.370016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.384142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bd23a1-53ad-42ef-960a-17346b5ab925 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.421055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.421676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.421952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.422224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.429222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.430641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:47:56.441907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:56.443258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:56.444104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 259/534] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:56.445078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.460033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.479812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.496712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe16ee6e-924c-427c-90bf-84a80e05ffc4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.532563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.533191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.533464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.533732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.540598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.542044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:47:56.553403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:56.555380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:47:56.557476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:56.558456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fd24e8-a831-4b63-ac48-b069ee3016a0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.560134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 276/535] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:56.560134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.593443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.593965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.594242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.594559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.595259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.595566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.597025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.611008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 260/536] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.611837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.666713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803dd699-dd57-4f79-b3ea-9acd0b05232b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.693617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.702905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.703536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.703844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.704153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.704823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.705123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.706920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.726864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 277/537] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.727770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.728803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2043533a-d9de-465c-b967-323d622b4fd9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.736506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.765447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.766053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.766332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.766609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.767906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.767906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.769400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.788191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 261/538] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.789156 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.838311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4ec503-8aef-41b3-b757-d8efd7063b74 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.876024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.876890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.877330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.877740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:56.878607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=85776df9b5714c989ae89e7103e309d5) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:56.879049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:56.881241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:56.887098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 278/539] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/role_assignments?user.id=85776df9b5714c989ae89e7103e309d5&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:56.888120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:56.916336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb5ff87-0531-410e-ae3a-7bda3ceaffb4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:56.966074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.979234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:56.998816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:56.999333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:56.999617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:56.999891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.000659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=07c8b4d86a684c31b3bdf12e1245ac2d) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:57.000969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:57.002473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccbdd7f-c1be-46ac-9c75-279c5d38e51f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:57.006658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8d81ac-a09b-49b7-ad82-158b084931d9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:57.018598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 262/540] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/role_assignments?user.id=07c8b4d86a684c31b3bdf12e1245ac2d&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:57.048173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:57.049100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:57.049520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:57.049994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.050900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=084559c0a60c45bbad27051a12a4f3a3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:57.051442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:57.053682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c438b8be-8acb-4720-acfa-5cbfaf2ede9a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:57.060494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 279/541] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:47:56 2022] GET /identity/v3/role_assignments?user.id=084559c0a60c45bbad27051a12a4f3a3&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:57.179986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de448c2-e706-47fb-9f24-24e6820e5c41 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:57.180305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de448c2-e706-47fb-9f24-24e6820e5c41 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:57.180495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de448c2-e706-47fb-9f24-24e6820e5c41 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.182370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 263/542] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:57.188129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dddf4-941a-4ad9-ac1f-457caf447788 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:57.189161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dddf4-941a-4ad9-ac1f-457caf447788 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:57.189633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562dddf4-941a-4ad9-ac1f-457caf447788 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.211385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-562dddf4-941a-4ad9-ac1f-457caf447788 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:57.213082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-562dddf4-941a-4ad9-ac1f-457caf447788 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:57.292322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 280/543] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:57.656275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de448c2-e706-47fb-9f24-24e6820e5c41 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:57.795590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de448c2-e706-47fb-9f24-24e6820e5c41 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:57.802425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e438b-d3fc-404a-9e64-2d21c355ecc6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:57.802732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e438b-d3fc-404a-9e64-2d21c355ecc6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:57.802980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0e438b-d3fc-404a-9e64-2d21c355ecc6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.804552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 281/544] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:47:57.811295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:57.811578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:57.811851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.833960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:57.835875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:57.859281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:57.860837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:57.861337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:57.861809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:57.880692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:57.886113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:57.886953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:57.887707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:57.893004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 264/545] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:57.900955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:57.931166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:57.948533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 282/546] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:58.027058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:58.089534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b4a7e1-b5eb-4f95-baef-001152fc3d29 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:58.135344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:58.135952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:58.136258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:58.136526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:58.137193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:58.137489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:58.138832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:58.151707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 265/547] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:47:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:58.156860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:58.262262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bec101-7841-42f4-a21d-27f408ee1f7a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:58.298358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:58.298982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:58.299256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:58.299526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:58.310383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:58.311820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:58.328483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:58.329410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:58.330214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:58.330214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:58.330214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:58.330214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 283/548] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:58.337010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:58.342632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:58.416405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:58.513919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece111-63f2-49b6-b65f-41513e1ecf79 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:58.520938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eee5e19-a555-40d2-baef-664e8399a48a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:58.552581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:58.578996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:58.580443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:58.581263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:58.582198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:58.587693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:58.588711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:58.589191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:58.589668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:58.590531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:58.591040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:58.592629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:58.598913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:47:58.606206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 266/549] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:47:58.608286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:58.609671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:47:58.610631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:58.612622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:58.614034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 284/550] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:58.627219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:58.779051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979149d4-8f4a-4fdb-84f3-ff8a6fa10be9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:58.792285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:58.831210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8044b7-f350-4e34-bc43-bdab6ff96524 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:58.853297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:58.853929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:58.854203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:58.854470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:58.855136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:58.855432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:58.857043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:58.875242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 285/551] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:47:58.879134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:58.903678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:58.904327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:58.904604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:58.904874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:58.918654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:58.923216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:47:58.943665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:58.944574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:58.946704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 267/552] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/users/swift => generated 83 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:58.950373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.024478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.080282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820c44b9-a018-4932-9ccf-4f57b7feb2c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.118282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:59.118960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.119235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.119547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.120870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:59.121172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:59.122756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:59.142926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 268/553] 10.222.0.72 () {56 vars in 1135 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:59.149217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.170910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b58f2b-1767-4608-a7d7-9a40fd80d682 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.215237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:59.216202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.216653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.217069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.229301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:59.230994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ce39b227-3bdd-4242-a0f2-cc6f9a0f53e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:59.245591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:59.246646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:59.247478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:59.247478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:59.247478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:59.250209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 286/554] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:47:59.251872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb632-425a-45f4-a4cc-b2629b72540b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.252440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb632-425a-45f4-a4cc-b2629b72540b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.252926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138fb632-425a-45f4-a4cc-b2629b72540b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.255402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 287/555] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:59.256437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb632-425a-45f4-a4cc-b2629b72540b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.281300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.294390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.300670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81715ddf-5525-49a8-8705-df9968c42168 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.348093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ff83b-8af5-4c13-8e6a-8321d706e7f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:59.349365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ff83b-8af5-4c13-8e6a-8321d706e7f6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.349711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ff83b-8af5-4c13-8e6a-8321d706e7f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.350375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ff83b-8af5-4c13-8e6a-8321d706e7f6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.375341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138fb632-425a-45f4-a4cc-b2629b72540b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.413849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:59.414565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.414915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.415190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.415930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:47:59.416262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:59.417709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75ec028-a028-4129-a87a-abfbeef886d6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:59.432217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 288/556] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:47:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:47:59.432217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36658-eb25-4e6f-ad99-e40e45a809de None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.432217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36658-eb25-4e6f-ad99-e40e45a809de None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.432217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b36658-eb25-4e6f-ad99-e40e45a809de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.436082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ff83b-8af5-4c13-8e6a-8321d706e7f6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:59.437573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ff83b-8af5-4c13-8e6a-8321d706e7f6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:59.451286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-23b36658-eb25-4e6f-ad99-e40e45a809de None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:59.452478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-23b36658-eb25-4e6f-ad99-e40e45a809de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:59.525010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 289/557] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:59.526264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c5f2-491e-43b8-9b9d-4a54cc6ad4c4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.526550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c5f2-491e-43b8-9b9d-4a54cc6ad4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.526825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae40c5f2-491e-43b8-9b9d-4a54cc6ad4c4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.528067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 290/558] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:59 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:59.528750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c5f2-491e-43b8-9b9d-4a54cc6ad4c4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.541577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.550486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.565149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 269/559] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:47:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:47:59.565149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570f64-5fb0-4954-9352-243cce0d0c6c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.565149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570f64-5fb0-4954-9352-243cce0d0c6c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.565149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d570f64-5fb0-4954-9352-243cce0d0c6c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.568167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 270/560] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:47:59 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:47:59.569684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.570281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.570559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.588778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:59.589973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:59.644947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae40c5f2-491e-43b8-9b9d-4a54cc6ad4c4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.662962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 271/561] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:59.663665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.690716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:59.691791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.692345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.692856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.700957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:59.702749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f8483c29-649a-446e-ab38-bc51a2a5c851 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:47:59.715691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:59.716679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:47:59.717583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:47:59.725406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 291/562] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:47:59 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:59.727022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.727506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.728125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.746748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:47:59.748360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:47:59.770729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79f127b-dbe8-4ab7-bca3-bc4e9640d6b2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.796390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.809082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:47:59.809776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:47:59.810036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:47:59.810311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:47:59.820950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:47:59.822513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:47:59.822732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:47:59.829878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 292/563] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:47:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:47:59.831360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:47:59.839509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:47:59.840797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:47:59.841651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:47:59.841651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:47:59.841651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:47:59.845384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 272/564] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:47:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:47:59.846303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:47:59.965601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab1316d-c8f5-4aef-9352-08a2c6150c3f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:47:59.969500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2189cc8-69fb-440d-b079-175eac085b77 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.001998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.002603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.002881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.003150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.003914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.004212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.006201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.007095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.007718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.008003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.008324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.019127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:00.025010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:00.025907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:00.026712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 273/565] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:47:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:00.027375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.049157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 293/566] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:47:59 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.049157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.070465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.109502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.138319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9670c2-fb65-4e15-a4be-da69871703ec None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.151883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58fcdd-27a4-4c61-8760-a65b3a6d55e7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.172268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.172868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.173143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.173411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.174042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.174341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.175697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.185829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.186523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.186805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.187078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.187838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 274/567] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.188711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.201828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:00.206596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:00.207676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:00.209014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 294/568] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:00.209712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.283077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.290019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478472eb-70e8-4724-a1bb-57d43fc4bf4b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.308027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce49875c-1caf-49be-9efd-8570b603fd36 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.323868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.324503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.324787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.325049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.325711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.325835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.326012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.327371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.335319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 275/569] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.336131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.343053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.343673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.343949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.344249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.354566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.356002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:00.370786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:00.371724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:00.372639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:00.372639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:00.372639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:00.372639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 295/570] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:00.372639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.441639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089dd0ac-d8e1-4a13-8d9e-1f8a14bcf156 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.471469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58984d0-7a39-4012-a416-323bdfa6008d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.475726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.476377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.476656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.476926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.486714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:00.492364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:00.493272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:00.494089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 276/571] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:00.494765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.508390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.509019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.509297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.509574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.513108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.516389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.518073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:00.529605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:00.530700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:00.531718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 296/572] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:00.536815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.565384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.594518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bc610c-530b-4771-baae-f87984674235 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.628569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.629161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.630053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.630320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.630969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.631263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.632635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.635284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea71ecb7-d40c-43ee-910a-5f5232a973ae None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.640305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 277/573] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.641178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.668886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.669507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.669784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.670057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.681230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.682668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:00.696907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:00.697887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:00.698751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:00.698751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:00.698751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:00.699267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 297/574] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:00.700059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.724314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.743895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7932a80-45c1-46b5-8e49-b78e739b3580 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.777061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.777660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.777938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.778210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.778846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.779145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.779976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.780541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.793315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 278/575] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.794207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.800223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261e330-0d3f-43b2-a792-77ba69e4d38d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.834040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.834644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.834923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.835195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.835863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.836222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.837583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.845345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 298/576] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.846124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.898095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682c2466-8d49-47f4-8014-57f612ca44f4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.932645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.933240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.933521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.933801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.934493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:00.934801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.936260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.945182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:00.947953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a92896b-899e-415d-b039-5797b73eebdb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:00.952207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 279/577] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:00.953061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:00.983233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:00.983928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:00.984234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:00.984513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:00.995307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:00.996776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:00.999226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:01.011752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:01.012863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:01.013924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:01.013924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:01.013924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:01.013924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 299/578] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:01.013924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.055200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d120694e-6383-4df3-bbf9-603bba906de6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.088000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.088621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.088896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.089163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.089799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:01.090095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.091455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.103442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 280/579] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:01.104258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.112818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36853cd6-c421-42c1-bf1d-24fed2c41ae5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.146940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.147560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.147845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.148144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.155908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.157386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.164253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:01.170078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:01.171022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:01.171913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 300/580] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:01.172427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.209287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25676a6c-fe88-47eb-9396-1596b068135b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.231042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.242399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.243017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.243294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.243565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.253547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.255054 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:01.270860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:01.271843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:01.272751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:01.272751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:01.272751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:01.272751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 281/581] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:01.272751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.276916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93635a-2e8b-41e6-9fbe-89f461ec6270 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.310701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.311433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.311704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.312071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.312875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=bb3a4609c413473ebfdda8bddedc631c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:01.313181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.314600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.320232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 301/582] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/role_assignments?user.id=bb3a4609c413473ebfdda8bddedc631c&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:01.320938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.386954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425119a7-4a2f-464b-9c76-4e771b19e8af None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.401947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.424299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.424521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.424798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.425071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.425784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:01.426094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.428021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.438123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d606881-39b2-419c-a299-b95519d3ca3f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.441283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 282/583] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:01.441755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.466873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.491431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.492087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.492366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.492711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.500477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.501945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:01.513833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:01.514768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:48:01.515698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:01.519714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 302/584] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:01.521241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.555034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60c4907-1ddb-4ce9-a81b-2f519952afc5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.592631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.593232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.593510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.593779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.594466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:01.594763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.596215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.608085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 283/585] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:01.608838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.636923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6599d976-386d-4145-a124-8ff5d1406881 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.644763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.673247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.673851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.674134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.674412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.675060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:01.675364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.676862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.693903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 303/586] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:01.694744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.726111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e1d248-786b-40ff-8b55-b4dc0e2a547c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.743526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.763564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.764223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.764554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.764765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] PATH_INFO: `/v3/users/glance` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.772842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.774267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:01.785342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:01.787027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 284/587] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/users/glance => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:01.787967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.811288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75bab760-373d-49a3-9ecd-e18ae700923b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.850364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.850970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.851250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.851524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.852279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:01.852583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.854008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.877346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 304/588] 10.222.0.72 () {56 vars in 1139 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:01.878211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:01.884488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:01.893753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c6b0c-b1fb-4186-893f-7a2f7baab79e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:01.927754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:01.928441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:01.928720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:01.928995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/a4e5a17f91134c59bec66f04a175ef05/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:01.945251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=a4e5a17f91134c59bec66f04a175ef05, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:01.946698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:01.964688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 285/589] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:01 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/a4e5a17f91134c59bec66f04a175ef05/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:01.965830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.020498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.025534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec1d63cb-7463-4ae7-9599-66dd0401b568 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.068146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.068798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.069075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.069349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.078184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.079631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:02.094061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:02.095144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:02.096112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 305/590] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:02.096698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.108342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dad9176-e476-4e8b-bece-b1c8fca273fd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.163064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.164341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.165281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.165737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.166664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:02.167159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.168949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.185709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.189498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 286/591] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Aug 25 02:48:01 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:02.190507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.220000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c151882-e6f2-4e13-8561-9dbe4a0ddc34 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.256224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.256851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.257132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.257400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.268610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.270118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:02.285455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:02.287070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:02.287938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:02.287938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:02.287938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:02.287938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 306/592] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:02.288619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.305481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.332419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a105c664-0be0-4c22-bfe6-9b4c954ee32f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.376995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.378028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.378306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.378842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.379736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:02.380144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.382341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.401524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7584c94-1700-4ff6-89f5-c837dd66531f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.408056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 287/593] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:02.408999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.439692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.440430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.440776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.441050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.452893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.454321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:02.470588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:02.471562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:02.472472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:02.472472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:02.472472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:02.472472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 307/594] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:02.472705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.492914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.536114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04d1a9-1b2f-47bf-99c2-1384b7b1dc0e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.545589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.586665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.587271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.587546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.587812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.588510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:02.588809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.590163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.600714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c4e326-aafb-4c48-8ff3-fb910240740f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.607292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 288/595] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:02.608283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.649196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.650214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.651194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.651645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.667272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.669923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:02.689172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:02.690181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:02.691042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:02.691042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:02.691042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:02.694185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 308/596] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:02.695455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.724298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24815ddb-9bf4-4aac-8f2a-8d0de1aaa909 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.749569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.774672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.775512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.776208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.776660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.778333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:02.778790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.780333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.796993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 289/597] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:02.798093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.814830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775128a7-c88b-4c82-ab04-3703276e3c6f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.831167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:02.855335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.856468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.856468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:02.856933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:02.865023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:02.866771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:02.878927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:02.880213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:02.881792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:02.883198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 309/598] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:02.888572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:02.947555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3125ed5d-f2b5-4439-9d78-0c83c602e8af None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:02.997846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:02.998697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:02.999624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.000147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.001232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:03.001685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.004098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.012937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5acbce-ec8f-4b94-b9e4-5601a3ada1d7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.021666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 290/599] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:03.022784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.061793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.062728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.063152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.063589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.066013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.074682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.076422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:03.088591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:03.089606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:03.090656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:03.092643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 310/600] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:03.093569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.131016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.148525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9b7b7e-fb78-4f0c-8b78-cabac887e65e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.189420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.190184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.190563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.190936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.192278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:03.192799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.194415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.208689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 291/601] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:03.209326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18aee5b-0043-4562-89aa-dab5580e4d25 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.209859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.247044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.248004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.248583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.249036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.257124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.258900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:03.271506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:03.272450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:03.273315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:03.275759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 311/602] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:03.276725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.315628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.320415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73e38a4-3885-4fe5-b0d5-5ae0c5c4d839 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.357691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.358297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.358575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.359234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.359941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:03.360279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.362047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.376004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 292/603] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:03.377232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.384629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.393347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65147c46-d6c9-4a41-9910-d0ab7984def0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.429972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227f414e-90f5-4f4d-8e75-789d9d1a6cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.430698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f414e-90f5-4f4d-8e75-789d9d1a6cb2 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.430894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f414e-90f5-4f4d-8e75-789d9d1a6cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.431162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227f414e-90f5-4f4d-8e75-789d9d1a6cb2 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/084559c0a60c45bbad27051a12a4f3a3/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.446192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f414e-90f5-4f4d-8e75-789d9d1a6cb2 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=084559c0a60c45bbad27051a12a4f3a3, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.447654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-227f414e-90f5-4f4d-8e75-789d9d1a6cb2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.472134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 312/604] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:03 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/084559c0a60c45bbad27051a12a4f3a3/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:03.474701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd18b-0e9f-48ff-9de9-bd9c55063e00 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.475136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd18b-0e9f-48ff-9de9-bd9c55063e00 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.475565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7bd18b-0e9f-48ff-9de9-bd9c55063e00 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.477208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 313/605] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:03.477885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd18b-0e9f-48ff-9de9-bd9c55063e00 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.497809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944fa12c-50d9-42a0-a249-e1271e22aebc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.545945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.546918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.547380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.547830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.548808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:03.549358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.551345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e1938c-d6de-42ec-a520-4b007c15b7e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.565472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 293/606] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:03.567189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.567683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.568214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.590073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:03.591734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:03.610962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.643201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7bd18b-0e9f-48ff-9de9-bd9c55063e00 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.692163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 294/607] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:03.692163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:03.693570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.694290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.694566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.694838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/85776df9b5714c989ae89e7103e309d5/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.724568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=85776df9b5714c989ae89e7103e309d5, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.726024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.735557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.778279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 314/608] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:03 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/85776df9b5714c989ae89e7103e309d5/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:03.831180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08af79-9434-4767-b1a9-ba6ce0a64923 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:03.871671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c0cca-5d7c-4293-b3c3-91895cdc09c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:03.872381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0cca-5d7c-4293-b3c3-91895cdc09c1 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:03.872662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0cca-5d7c-4293-b3c3-91895cdc09c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:03.872931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c0cca-5d7c-4293-b3c3-91895cdc09c1 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/07c8b4d86a684c31b3bdf12e1245ac2d/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:03.890553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0cca-5d7c-4293-b3c3-91895cdc09c1 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=07c8b4d86a684c31b3bdf12e1245ac2d, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:03.892338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c0cca-5d7c-4293-b3c3-91895cdc09c1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:03.914153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:03.920630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 295/609] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:03 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/07c8b4d86a684c31b3bdf12e1245ac2d/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:03.999488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.123822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71b908b-4754-45f3-9c80-a0e6c4e6d050 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:04.167233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:04.167874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.168181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.168450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.180738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:04.185502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:04.186419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:04.187475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 315/610] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:04.190305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b2fe-c94c-402d-8c15-869fd68ebf1b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.191121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b2fe-c94c-402d-8c15-869fd68ebf1b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.193396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.196530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e298b2fe-c94c-402d-8c15-869fd68ebf1b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.197992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 296/611] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:04 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:04.203512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.203796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.204087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.235381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:04.236610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:04.269650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:04.333389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f11ff3-264e-4440-a3ca-85cf2319fb41 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:04.348998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 297/612] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:48:04.392623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:04.393583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.394076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.394544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.395956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:04.396520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:04.398098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:04.410509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 316/613] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:04.416940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.546406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec8c653-5b7e-4ba6-87c8-5c571a67f591 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:04.576647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:04.583427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:04.584219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.584923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.585404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.596535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:04.598632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:04.615771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:04.617719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:04.619201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:04.619201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:04.619201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:04.621397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 298/614] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:04.626696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.657159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.795249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b60dca6-d675-4a12-91b3-32452cf3a531 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:04.813025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5230c3-2e0f-49e5-b1e2-1eeeadde24e5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:04.845767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:04.846722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.847206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.847665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.848368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:04.872791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:04.878043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:04.878964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:04.880374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:04.887142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 299/615] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:04.888330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:04.888955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:04.889237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:04.889513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:04.890173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:04.890477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:04.892122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:04.902035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.920121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 317/616] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:04.925754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:04.988602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:05.059424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d854b511-abc5-4223-bfcb-553f7d799950 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.076404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d655337-3d06-40cc-9ccb-573f7d5b68da None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.101953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.102561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.102841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.103117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.103786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:05.104109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.105482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.126425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 300/617] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:04 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:05.131224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:05.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.148126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.148454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.148899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.161331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.164850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:05.186512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:05.187467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:05.188456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 318/618] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:05.198787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:05.265834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:05.316091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3cb5042-a8fd-446c-8277-e25fe2bd7de4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.328382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:05.375011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4262000d-073b-4e2f-af47-d25664d269a6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.379436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.380080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.380358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.380627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.400569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.402046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:05.429042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:05.430216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:05.431093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:05.431093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:05.431093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:05.431093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 301/619] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:05.437132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:05.454115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.454732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.455013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.455287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.456029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:05.456359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.457841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.476324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 319/620] 10.222.0.72 () {56 vars in 1135 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:05.481787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:05.585528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d05bbe-efb0-4f64-bc07-fdaa7f4fa191 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.588405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:05.624563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.625215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.625478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.625746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.636950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.638391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.663050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e4f99a-dc6a-4d96-82d7-a0465eeea8b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:05.670216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:05.671103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:05.672400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:05.672400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:05.672400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:05.672400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 320/621] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:05.680931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:05.732629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.733249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.733532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.733801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.734448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:05.734749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.736602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1be031-3355-42cc-91c1-1fa66781c5f9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.756144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 302/622] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:05.757480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378cfb-5191-4797-9919-576955dfd898 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.757765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378cfb-5191-4797-9919-576955dfd898 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.758036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec378cfb-5191-4797-9919-576955dfd898 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.759421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 303/623] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:05.760698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378cfb-5191-4797-9919-576955dfd898 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:05.780882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:05.823393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c590d3-62d8-4387-a408-75dd3387d2f0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.874942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.876149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.876606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.877058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.877892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:05.878364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.878480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec378cfb-5191-4797-9919-576955dfd898 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:05.880441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e928a7-ef59-45e4-a72d-03333ceba8c4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.897608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 321/624] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:05.899184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.899627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.900104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.916626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:05.923518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:05.924556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:05.925218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:05.925342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:05.925716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:05.926182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:05.935305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:05.936808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:05.950901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:05.951852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 304/625] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:05.958691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.032356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 322/626] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:06.034744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.049361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.094232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a184361b-adc5-469b-a293-770d58f8ceeb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.170980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.172089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.172595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.173212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.186693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:06.189577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:06.213244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:06.214257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:06.215179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:06.218284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 305/627] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:06.226095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.244390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df0b8-0d73-49e9-90e9-212af721ce7a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.319248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.320725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.321222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.322112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.323538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:06.324369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:06.326739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b50733-379b-4e27-832b-140cf028c5dc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:06.330693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.353831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 323/628] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:48:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:06.355128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b60ac-2c65-42ee-b50c-20a8f5584b22 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.355412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b60ac-2c65-42ee-b50c-20a8f5584b22 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.355689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782b60ac-2c65-42ee-b50c-20a8f5584b22 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.360139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 324/629] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:06.360936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b60ac-2c65-42ee-b50c-20a8f5584b22 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.392649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717796c-6b21-4edb-b365-748361355ec0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.425808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.426474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.426751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.427021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.427700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:06.428004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:06.429437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-860a3e31-6c54-46d3-af0f-1493248eef84 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:06.430991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.442142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 306/630] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:06.443334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9c51-be48-48dd-aff2-7ecaa7cfcaf2 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.443622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9c51-be48-48dd-aff2-7ecaa7cfcaf2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.443904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5b9c51-be48-48dd-aff2-7ecaa7cfcaf2 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.445144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 307/631] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:06.446148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.446431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.446704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.464380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:06.465523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782b60ac-2c65-42ee-b50c-20a8f5584b22 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.465637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:06.500090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ad6b3b-611e-4804-8391-e7455452f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.500694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6b3b-611e-4804-8391-e7455452f183 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.501055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6b3b-611e-4804-8391-e7455452f183 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.501335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ad6b3b-611e-4804-8391-e7455452f183 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.531930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 308/632] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:06.532822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.577457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.586168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6b3b-611e-4804-8391-e7455452f183 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:06.587615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ad6b3b-611e-4804-8391-e7455452f183 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:06.638327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ada179-bfc3-4aeb-9693-48027de451a3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.663525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.675050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.675752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.676460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.676780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.687018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:06.691680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:06.692799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:06.693633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 309/633] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:06.694335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.697575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 325/634] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:48:06.698901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.699186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.699457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.718191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:06.719381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:06.788941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 326/635] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:06.790102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.815754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.820510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b613bf14-858f-4eff-b879-9b76d034336d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.855562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.856222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.856501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.856777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/bb3a4609c413473ebfdda8bddedc631c/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:06.871911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=bb3a4609c413473ebfdda8bddedc631c, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:06.873372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:06.886970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 310/636] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:06 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/bb3a4609c413473ebfdda8bddedc631c/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:06.887770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:06.910319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042d67e0-66bb-4b8a-bd8f-0fc2bf47350d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:06.928995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:06.994655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:06.995338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:06.995705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:06.996067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.008578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.010282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.027892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa9c424-2de0-4f18-a4d6-71edba0d560f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:07.028571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:07.029517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:07.030397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:07.030397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:07.030397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:07.030397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 327/637] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:07.031372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.073791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.074292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.074572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.074849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.075502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:07.075801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.077219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.086992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 311/638] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:07.088010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.130669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.157307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fcf1f7-2a05-4eac-9eff-e6ef00e17afd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.186309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.193272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.193557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9490a114-1c89-44aa-bd8f-096b3a89de2d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.193898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.194173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.194441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.206989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:07.213125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:07.214101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:07.214947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 328/639] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:07.215637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.236001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.236631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.236908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.237177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.237816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:07.238920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.240274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.258525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 312/640] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:07.258525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.328303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a638280-fd00-44a5-80ad-b299737f761a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.366181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2a7846-0d0d-4297-88e0-7de0b6ad6e68 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.369785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.370421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.370701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.370976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.373754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.383303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:07.388542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:07.389453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:07.390276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:07.395335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 329/641] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:07.396611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.403306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.403936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.404276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.404516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.415632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.417110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:07.431741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:07.432775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:07.433650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:07.433650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:07.433650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:07.433650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 313/642] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:07.433650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.444918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.507984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9d2b27-4cea-41b2-b141-c294d8bc2398 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.545022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.545659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.545935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.546201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.546957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:07.547257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.548667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.550465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc27d0f-97b4-4972-ab37-b3dfa9b1fc4a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.557275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 330/643] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:07.557888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.591421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.592165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.592445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.592716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.600664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.602209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:07.614356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:07.615212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 314/644] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:07.616670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.625413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.670246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf69985c-6537-414a-bf48-d5d8ad4cde09 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.688906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.706824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.708188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.708545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.708871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.709597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:07.710064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.711314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.719436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 331/645] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:07.720229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.731090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8cde8d-f423-41fc-8b0d-809b631455b9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.769263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.770823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.771233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.771578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.772334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:07.772704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.774143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.793091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 315/646] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:07.794066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.824728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5be2d6d-3215-4ebe-9fec-e6b99368deff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.846123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.866548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.867192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.867474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.867747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.881091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.882554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:07.897705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:07.898648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:07.899506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:07.899506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:07.899506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:07.899506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 332/647] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:07.899737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:07.909546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf1f580-847b-47d8-b3c8-fa0a8c5cea3f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:07.941210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:07.953334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:07.954112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:07.954486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:07.954863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:07.955637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:07.956011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:07.958104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:07.969905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 316/648] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:07.970701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.029460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f338e6-7357-4648-8a37-a4aba0cd9cf8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.076259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.076990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.077336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.077676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.079847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0dcbbcc-5adb-473d-8000-a6dcde67133a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.088898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.090338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:08.105472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:08.106397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:08.107287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:08.107287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:08.107287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:08.107287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 333/649] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:08.107287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.124268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.124714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.124997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.125272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.133716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.135148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.135870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:08.147886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:08.149067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:08.150027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 317/650] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:08.150647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.206098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.219007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85904f92-209a-481f-bfeb-fe8cb62b0d07 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.256682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.257484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.257766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.258183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.258830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:08.259132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.260531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.260906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd4e163-1a7f-410b-8128-81cd4b303c0c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.273814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 334/651] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:08.274636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.305585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.306195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.306472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.306748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.307470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=a4e5a17f91134c59bec66f04a175ef05) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:08.307778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.309245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.316306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 318/652] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/role_assignments?user.id=a4e5a17f91134c59bec66f04a175ef05&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:08.316768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.398006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.418344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77fe9ee-40a4-4299-905f-5139650f8858 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.448220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15612be9-9f19-49f4-8e27-0785bdf2ee16 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.460699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.461667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.462140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.462823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.463414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.464456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:08.464949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.468427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.479237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 335/653] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:08.480523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.486098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.486714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.486994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.487265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.488015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:08.488533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.490075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.514271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 319/654] 10.222.0.72 () {56 vars in 1139 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:08.514271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.611583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1baef1d7-92d5-45ae-9793-9921f1c80f6e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.640176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f2fd58-301b-42a0-b53d-ab8bb58e3b08 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.653082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.653963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.654383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.654815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.664283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.666038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:08.678714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:08.679767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 25 02:48:08.680912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:08.683237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 336/655] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/users/glance => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:08.684179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.690214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.691022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.691457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.692580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.693754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.701849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.703476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:08.717559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:08.718672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:48:08.719811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:08.722262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 320/656] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:08.723369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.756971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:08.817057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284d645e-4d32-4543-81f2-28b12a8e0423 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.835549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fb5f3e-bd66-4c25-9379-02173195c1f8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:08.863221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de724644-e154-4661-9336-06e068d9cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.864663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724644-e154-4661-9336-06e068d9cddb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.865111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724644-e154-4661-9336-06e068d9cddb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.865509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de724644-e154-4661-9336-06e068d9cddb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.881097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:08.881853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:08.882210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:08.882551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:08.883358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:08.883735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.885344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.907561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 321/657] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:08.907561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:08.941097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de724644-e154-4661-9336-06e068d9cddb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:08.943378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de724644-e154-4661-9336-06e068d9cddb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:08.947722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.014866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.029702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40136453-3627-422c-a225-0dda921bdb05 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.053883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 337/658] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:48:09.055035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d937b92-1ae7-471a-b90c-d7fdb1555916 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.055321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d937b92-1ae7-471a-b90c-d7fdb1555916 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.055597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d937b92-1ae7-471a-b90c-d7fdb1555916 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.061056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 338/659] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:09 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:09.061837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d937b92-1ae7-471a-b90c-d7fdb1555916 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.065582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.066184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.066489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.067419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.068247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:09.068554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.069972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.088077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 322/660] 10.222.0.72 () {56 vars in 1137 bytes} [Thu Aug 25 02:48:08 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:09.088841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.168076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d937b92-1ae7-471a-b90c-d7fdb1555916 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.170440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.193889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b19af8-6177-48be-b723-62ad43e78602 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.206166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.206845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.207261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.207607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.229663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.230359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.230710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.231043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.242326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.243888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.250765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-707992df-54d7-4c12-92cc-91f367a961f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:09.262237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:09.263210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:09.264116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:09.264116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:09.264116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:09.264116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 323/661] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:09.265107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.265397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.265735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.283426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.283972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:09.284912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.285780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:09.360319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 324/662] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:09.360319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.407435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 339/663] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:48:09.408591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.413402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.490289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a4fd6e-924a-427b-ace7-8b632ea1e35f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.519730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.528913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.529710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.530160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.530584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.535774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8088a42-69a9-494e-ba2a-22095bdbb67d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.579642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.580596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.581061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.581515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.582425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:09.582913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.584683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.597209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 340/664] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:09.598442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.622519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.625366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.670709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.710734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32e2e71-fbb8-443e-986a-162556dd33a8 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.737090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 325/665] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:48:09.737924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.750278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.751034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.751393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.751754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.763383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.764945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.769132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:09.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:09.782477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:09.783553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:09.783553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:09.783553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:09.789937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 341/666] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:09.789937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.847501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99e9646-4725-4378-90ee-b11f554f111e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.884365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.885319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.885884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.886154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.891899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64519e89-c8ad-49f2-a370-3ea41f8ce352 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:09.893555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:09.895438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:09.907377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:09.908595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:09.915235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:09.915749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:09.915835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 326/667] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:09.915835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:09.937696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:09.938945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:09.938945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:09.938945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:09.951787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:09.957312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:09.958243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:09.959079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 342/668] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:09.959761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.025613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.039775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f268768-4669-45d0-b122-da85daeeb3d9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.071041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e39aab3-52aa-4935-a3b6-070137cf1d78 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.077920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.078552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.079238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.079529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.092011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.093524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.108463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:10.108657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:10.114907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:10.116074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:10.116074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:10.116074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:10.116074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 327/669] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:10.116375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.116375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.116532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.116613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.116613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:10.116613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.116613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.131327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 343/670] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:10.136469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.172928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.219709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ee20a8-b9eb-45a5-a58f-50f4898399d1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.243465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312628c6-9ead-4213-9931-921b52bb2a1e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.254707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.255432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.255914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.256307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.257090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:10.257515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.259277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.269427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.274084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 328/671] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:10.275097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.283319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.283929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.284348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.284626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.285395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:10.285700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.287226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.295600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 344/672] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:10.296203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.383759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158535f5-b136-4b24-affe-998c6b654670 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.404451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.408709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c4480c-f9ca-42e5-8b79-eedebdcf63f0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.421367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.421963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.422239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.422508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.423146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:10.423446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.424825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.435994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 329/673] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:10.436797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.448909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.449538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.449818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.450090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.456716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.458640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:10.469519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:10.470572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 345/674] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:10.471454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.499173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.541376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ae8c54-c946-4b99-91eb-ad23936d65fd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.571978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cf2f76-19ed-40a7-9115-36957132c487 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.574110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.574701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.574974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.575242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.575955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=084559c0a60c45bbad27051a12a4f3a3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:10.576285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.577690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571c3d7b-b2f3-41c2-a86a-ff954137c4ee None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.583995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 330/675] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/role_assignments?user.id=084559c0a60c45bbad27051a12a4f3a3&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:10.585230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512ef9-7829-4b7d-a2ec-17e431af7c81 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.585515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512ef9-7829-4b7d-a2ec-17e431af7c81 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.585783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de512ef9-7829-4b7d-a2ec-17e431af7c81 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.587118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 331/676] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:10 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:10.587720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de512ef9-7829-4b7d-a2ec-17e431af7c81 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.614608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.615259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.615532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.615797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.627182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.628687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:10.644692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:10.646246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:10.652460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:10.652460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:10.652460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:10.652460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 346/677] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:10.652460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.666003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.726574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de512ef9-7829-4b7d-a2ec-17e431af7c81 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.757207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.772911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.773550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.773834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.773995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa3dc52-0ce0-4ec6-9fd5-f45cde58006c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:10.774135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.782145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.783598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-06c28b62-cbbb-44a9-b960-7b356e91f41d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:10.795838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:10.796933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:10.798009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:10.800291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 332/678] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:10.802454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.803520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.803806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.814676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:10.815286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:10.815564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:10.815837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:10.816765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:10.817071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:10.818493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:10.824844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:10.826453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:10.830843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 347/679] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:10.836139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.904702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 333/680] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:10.905930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:10.918064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:10.973558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6bb6ed6-bcbf-4cef-bc78-a02d4905c6f0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.020399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.021594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.022466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.023059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.024111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:11.024638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.025307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f7cd5-774f-4b0f-a3ba-bb5e0f649b9d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.026422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.041691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.048784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 348/681] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:11.050602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.065211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.065953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.066297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.066783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.067546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:11.067921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.069440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.081902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 334/682] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:11.088299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.172051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ec7d17-c0ac-40f2-ac83-40eecc1d1b6d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.200381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.204887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d96184-0e8e-45e6-81d5-ffab92763c1f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.205963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.208179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.208179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.209341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.209780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=85776df9b5714c989ae89e7103e309d5) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:11.210091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.211534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.224070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 349/683] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/role_assignments?user.id=85776df9b5714c989ae89e7103e309d5&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:11.224070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.252863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.253766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.254856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.255277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.264303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.266111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:11.279775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:11.281000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:11.281916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:11.284160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 335/684] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/users/swift => generated 83 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:11.285906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.327541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.352708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143be40a-e35c-47ca-8b3b-3d081cdc2053 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.392981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.393987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.394512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.395610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.396748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=07c8b4d86a684c31b3bdf12e1245ac2d) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:11.397272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.398920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.405830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 350/685] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/role_assignments?user.id=07c8b4d86a684c31b3bdf12e1245ac2d&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:11.406811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2037c2c-b845-4a53-821f-7ca1639cb249 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.407118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.447220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.447719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.448002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.448309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.463000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:11.470526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:11.471530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:11.472813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 336/686] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:11.478516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.480934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.534285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1033ee-edfb-4446-ba3d-fa1108f7de46 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.576798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.577176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.577369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.577676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.578443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:11.578753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.580339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.596744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.604029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 351/687] 10.222.0.72 () {56 vars in 1135 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:11.608533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.611998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3789f953-a0e7-47ee-a03b-7902341d0cb9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.660974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.662074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.662508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.662937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.663814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:11.664984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.666576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.678981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 337/688] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:11.683841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.737985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778e63c4-ae53-475f-9a50-3bd12e78e4ef None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.757605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:11.779561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.780208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.780495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.780772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.818675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afe6bcb-72be-4062-9673-04c0f4250b27 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:11.883002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:11.883555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:11.883885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:11.884192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:11.889719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.891182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.909993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:11.913683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:11.949326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:11.950478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:11.951579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:11.951579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:11.951579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:11.961427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 338/689] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:11.968381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:11.990697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:12.035378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 352/690] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 25 02:48:12.040926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.061286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:12.153738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa220f9-3a15-4e11-b652-63ef16cb8391 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.196811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.197498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.197783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.198057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.217217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67efae62-3195-4abf-b0bb-915c846ba671 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.219259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.220759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:12.257717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:12.258913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:12.259893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:12.259893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:12.259893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:12.259893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 353/691] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:12.263352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.268461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.269078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.269360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.270220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.270879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:12.271186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.279480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.310500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 339/692] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:12.316279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.354796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:12.392763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cfaa8-b33a-42eb-ad04-11ded9198d4e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.435077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.435607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.435886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.436185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.436845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:12.437148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.438524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.467286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 354/693] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:12.474327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.475087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:12.518614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60641a26-3cda-46a8-8de9-9e94f42e1935 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.559577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.560235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.560520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.560795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.570587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.572034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:12.585834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:12.586796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:12.587729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 340/694] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/users/nova => generated 82 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:12.593730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.648232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6f9d9e-9385-434d-a1fe-de3443f52ea9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.693522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:12.706507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.706507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.706507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.706507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.714765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.716251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:12.731803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:12.732784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:12.733640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:12.735302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 355/695] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:12.741520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.795199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b4b722-c597-4a77-a2ab-1104260d1c66 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.829065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:12.839382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.840128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.840483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.840827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.841643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:12.842038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.843539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725da9ed-8d89-4af2-abd4-f0838afb01e7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.862855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 341/696] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:12.864840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8809ce-0efe-4696-ac5b-edd1574e3038 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.865197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8809ce-0efe-4696-ac5b-edd1574e3038 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.865551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8809ce-0efe-4696-ac5b-edd1574e3038 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.866987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 342/697] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:12.872343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8809ce-0efe-4696-ac5b-edd1574e3038 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:12.893056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929c1854-955f-4474-bf7c-d3625a48ff16 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:12.946230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5011361d-8687-41a3-a41f-387805760665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:12.946923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011361d-8687-41a3-a41f-387805760665 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.947324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011361d-8687-41a3-a41f-387805760665 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.947701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5011361d-8687-41a3-a41f-387805760665 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.951414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011361d-8687-41a3-a41f-387805760665 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:12.951836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011361d-8687-41a3-a41f-387805760665 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:12.953462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5011361d-8687-41a3-a41f-387805760665 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:12.967732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 356/698] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:12.969209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8398-13e9-4219-b109-09035f898144 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:12.969599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8398-13e9-4219-b109-09035f898144 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:12.969998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba8398-13e9-4219-b109-09035f898144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:12.991711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-09ba8398-13e9-4219-b109-09035f898144 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:12.993212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-09ba8398-13e9-4219-b109-09035f898144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:13.004563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8809ce-0efe-4696-ac5b-edd1574e3038 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.042821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.043691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.044179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.044633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.052195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.084320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 357/699] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:13.085338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8398-13e9-4219-b109-09035f898144 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.110384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.128445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.130274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.243609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 343/700] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 25 02:48:13.249504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.256619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba8398-13e9-4219-b109-09035f898144 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.294472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.295305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.295590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.295861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.296645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=bb3a4609c413473ebfdda8bddedc631c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:13.296953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.298373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.305733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 358/701] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/role_assignments?user.id=bb3a4609c413473ebfdda8bddedc631c&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:13.351730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.370823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b633873-b9d8-4cc0-a81a-1c5685997cce None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.409838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.411402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.411909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.412423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.423974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.426425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:13.443392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:13.444450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:13.445337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:13.445337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:13.445337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:13.447731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 344/702] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:13.453392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.500932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.521992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.608081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d660e72b-ccda-4e2c-b694-c404f7d25a59 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.641088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d39def-1f39-4b4d-b0d0-78fe3a2f2f91 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.666855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.667762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.668071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.668385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.669316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:13.669646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.671697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.683466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.684271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.684624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.684907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] PATH_INFO: `/v3/services/network` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.685503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.686875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.687375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 359/703] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:13.693264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:13.701171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:13.702186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:13.703055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 345/704] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/services/network => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:13.708663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.711696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.828120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d3775a-4ca0-49e1-9acf-bb59080d49ff None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.830011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:13.837692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6623e64a-d722-49f9-936f-3ea5afcdf9f7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:13.869720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.870408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.870688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.870954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.874007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:13.874615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.874895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.875172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.875803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] RBAC: Adding query filter params (name=network) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:13.876133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.877498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb6d969-ec5c-4854-a738-4e5f5da5b891 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.877742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:13.880006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:13.883015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 346/705] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:13.884349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98329f9d-d428-4120-ae9c-dfe12dc41ad0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.884634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98329f9d-d428-4120-ae9c-dfe12dc41ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.884908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98329f9d-d428-4120-ae9c-dfe12dc41ad0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.886257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 347/706] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:13.887093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2be8-010e-45fd-b015-42ab1f304180 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.890593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2be8-010e-45fd-b015-42ab1f304180 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.891223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9b2be8-010e-45fd-b015-42ab1f304180 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:13.892361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:13.893235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:13.894104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 360/708] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:13.895182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:13.898036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 348/708] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:13.899308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:13.899593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:13.899866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:13.921859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:13.923035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:13.994391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.002466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 349/709] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:14.003363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.026022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6af3a5-f50e-43cd-90c2-305bccfe97de None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.068415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.069046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.069356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.069536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.070163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:14.070512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.071970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0d56f2-14c6-4c89-a387-b39ef070f2cf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.078245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 361/710] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:13 2022] GET /identity/v3/services?type=network => generated 124 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:14.079416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.079752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.080029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.105349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:14.107399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:14.119807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb940c0-bb0c-42c5-9f96-ae317b23f3af None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.140543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.188193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.189202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.189685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.190156 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.191116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:14.191681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.193910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.209738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 350/711] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:14.216551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.245817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 362/712] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:14.296189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.299984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.385816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b34cd22-bd7b-4a53-8e74-fafaf9c98a15 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.445127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.445735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.446013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.446282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.447015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=a4e5a17f91134c59bec66f04a175ef05) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:14.447320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.450210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.462113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 351/713] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/role_assignments?user.id=a4e5a17f91134c59bec66f04a175ef05&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:14.480600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b936c4d-1de9-40be-b06b-bab643eb6f07 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.536247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.536895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.537173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.537443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.552997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.554463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:14.574387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:14.575380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:14.576737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:14.576737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:14.576737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:14.576737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 363/714] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:14.585305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.612366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.632459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.754849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3b535-2713-41ca-9877-e624f5049eb3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.758992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d490d65-36af-412f-9fc2-1f13ae32a984 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:14.799694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.800358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.800749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.801205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.801900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.803411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.806286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:14.819141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:14.820263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:14.821236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:14.823647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 364/715] 10.222.0.72 () {56 vars in 1129 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:14.829628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.853858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:14.855260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:14.855754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:14.856353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:14.857316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:14.857882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:14.859702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:14.895235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 352/716] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:14.900361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:14.976792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:15.046584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fccfef2-9132-464b-826c-cc5ef9657210 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:15.103197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629c98d0-088f-45a7-a548-ce2cb7a0e71f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:15.132732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:15.133451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:15.133733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:15.134006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:15.134650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:15.134950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:15.136383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:15.153940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 365/717] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Aug 25 02:48:14 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:15.159573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:15.180130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9162ef41-d6dd-447a-90fa-206e9e6c9e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:15.180749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ef41-d6dd-447a-90fa-206e9e6c9e96 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:15.181033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ef41-d6dd-447a-90fa-206e9e6c9e96 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:15.181307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9162ef41-d6dd-447a-90fa-206e9e6c9e96 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:15.183796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162ef41-d6dd-447a-90fa-206e9e6c9e96 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:15.185551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9162ef41-d6dd-447a-90fa-206e9e6c9e96 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:15.231175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 353/718] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:48:14 2022] POST /identity/v3/users => generated 254 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:48:15.347087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fbbeb-71ac-472b-921a-0e7ca6a939e9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:15.386760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:15.387749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:15.388266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:15.388751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:15.389596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:15.390145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:15.392017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae453b1-9fa7-44be-8c77-c81a98cc7f27 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:15.395813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:15.399059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 366/719] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Aug 25 02:48:15 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:16.219223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542fccc-005d-41d7-a262-b8ba6190a805 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.220244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542fccc-005d-41d7-a262-b8ba6190a805 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.220766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b542fccc-005d-41d7-a262-b8ba6190a805 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:16.222668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 354/720] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:16.228166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1ae9-642b-4755-8b69-1cd2ef296b96 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.228951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1ae9-642b-4755-8b69-1cd2ef296b96 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.229607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037f1ae9-642b-4755-8b69-1cd2ef296b96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:16.249510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-037f1ae9-642b-4755-8b69-1cd2ef296b96 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:16.250994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-037f1ae9-642b-4755-8b69-1cd2ef296b96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:16.328146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 367/721] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:16.334048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5cd9-61db-405c-a52a-7d82babae5b6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.334588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5cd9-61db-405c-a52a-7d82babae5b6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.335055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445c5cd9-61db-405c-a52a-7d82babae5b6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:16.336593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 355/722] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:16.341727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.342017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.342293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:16.369623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:16.370815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:16.465233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 368/723] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:16.628036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c5cd9-61db-405c-a52a-7d82babae5b6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:16.681771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:16.772889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445c5cd9-61db-405c-a52a-7d82babae5b6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:16.813907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:16.814527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:16.814801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:16.815070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:16.825987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:16.830841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:16.831850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:16.833393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:16.837158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 356/724] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:16.838798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:16.910944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:16.916412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.005847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5302e9-5c6a-41b2-92ed-97a564dd90b5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.081267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.081899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.082304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.082675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.083346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:17.083643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:17.085031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f31bc48b-5329-4cb3-b754-bb1605953c45 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:17.094378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.100347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 369/725] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:17.101636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f0c8-587e-4379-a97d-92000ece03dc None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.101923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f0c8-587e-4379-a97d-92000ece03dc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.102202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e5f0c8-587e-4379-a97d-92000ece03dc None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.103425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 370/726] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:17.108855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.109137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.109412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.109514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90707fd7-4b51-4a2f-b025-6d07e6a7c29b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.131901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:17.133135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:17.151150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.152066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.152365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.152898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.153605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:17.155416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:17.179188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 357/727] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:16 2022] POST /identity/v3/services => generated 240 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:17.180172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.230693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 371/728] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:17 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 25 02:48:17.340714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01fadc3-4156-4a74-9496-9d4a0494a7b0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.382262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.382915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.383197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.383475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.395872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:17.397384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:17.412773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:17.414960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:17.417071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:17.417071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:17.417071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:17.417071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 358/729] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:17.420620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.521735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.593902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab74cbf-32ac-4047-b4f8-c67e4958def8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.612145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.624646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.657772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.658383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.658660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.658930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.659578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:17.660745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:17.662824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-537a70a3-deff-4177-95bd-bdceec5b41db None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:17.680716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 372/730] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:17.681994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d1b4-1406-41f2-8617-b005de3278c7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.682279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d1b4-1406-41f2-8617-b005de3278c7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.682555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae4d1b4-1406-41f2-8617-b005de3278c7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.684074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 373/731] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:17.689526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d1b4-1406-41f2-8617-b005de3278c7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.747188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e1e83e-4978-46bd-bffc-593bb0848a49 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.783663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab591b9a-8bc7-475e-a2f8-7338ef228162 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.784246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591b9a-8bc7-475e-a2f8-7338ef228162 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.784526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591b9a-8bc7-475e-a2f8-7338ef228162 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.785443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab591b9a-8bc7-475e-a2f8-7338ef228162 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.796589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab591b9a-8bc7-475e-a2f8-7338ef228162 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ab591b9a-8bc7-475e-a2f8-7338ef228162 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:17.802249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:17.803190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:17.804060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 359/732] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:17.805636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.805636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.805945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.809513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae4d1b4-1406-41f2-8617-b005de3278c7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:17.819665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.825376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:17.826692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:17.849298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:17.850036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:17.850390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:17.850738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] PATH_INFO: `/v3/users/swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:17.860582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:17.862266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:17.875419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:17.877636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 374/733] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:17.880404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.899024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:17.905122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 360/734] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:17 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:17.905938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:17.998425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564d3948-6b2c-44a9-9b8e-840cab795c5e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.038059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.038826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.039210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.039593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.040449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:18.040861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.042438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7c5a51-e73e-425c-bcd8-862362bf4999 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.053616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 375/735] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:18.055193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ce9f-311a-4e93-bcfb-c9588c45fcb0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.055640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ce9f-311a-4e93-bcfb-c9588c45fcb0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.056016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4ce9f-311a-4e93-bcfb-c9588c45fcb0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.057727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 376/736] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:18.065537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.065819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.066193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.085154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:18.086332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:18.112088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.136566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a4867f-a98f-456e-8c54-e2b56c788bd8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.164756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 377/737] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:18 2022] POST /identity/v3/auth/tokens => generated 898 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 25 02:48:18.165796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.205198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.206232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.206802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.207271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.208708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:18.209256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.211995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.239564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 361/738] 10.222.0.72 () {56 vars in 1135 bytes} [Thu Aug 25 02:48:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:18.240515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.291531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff26d03-a1ed-421a-a5d7-9002974c2bce None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.311450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.339683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.340352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.340635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.340914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.354724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.356457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.370566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910e9fe5-7143-4417-a676-1dedf3cd2499 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:18.374304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:18.375221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:18.376114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:18.376114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:18.376114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:18.378136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 378/739] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:18.379718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.397853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.417379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.418328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.418678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.419027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.419992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.422059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.443845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 362/740] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:18 2022] POST /identity/v3/services => generated 251 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:18.445066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.515888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4222ce-1955-4505-8466-2e8d447e0ce9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.567295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.567826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.568139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.568401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.585750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9e570d-3239-41fa-8d23-ddd6a0e0d6e6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.604346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.634759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.635366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.635641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.635911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.636594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:18.636933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.638252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.651666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 363/741] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:18.652853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.667434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.670182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.681119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.787453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 379/742] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:18.788625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.794365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68785aa-082b-41a4-b144-0b6b2187effb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.840542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.841481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.841757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.842023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.857918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:18.864554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:18.865478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:18.866290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:18.870685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 364/743] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:18.872474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:18.905845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d4674-2611-4bb5-a443-35f30841313c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:18.917011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.922674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:18.955904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:18.957127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:18.957641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:18.958125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:18.966093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:18.967825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:18.980592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:18.981562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:18.982498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:18.985024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 380/744] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:18.986016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.002196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366ce1af-1233-4d98-bcb5-3a2d40a7e61f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.047586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.048291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.048565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.048890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.060767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.062318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:19.077940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:19.078928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:19.079811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:19.079811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:19.079811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:19.083527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 365/745] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:19.084608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.108978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2630bd-a768-458c-aedb-99a0d8a6a7ba None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.151508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.152694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.153278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.153771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.154667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:19.155225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.157077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.166892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 381/746] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:19.167990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.181403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.194584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ef70d-23b8-4043-ad1b-00763fad556e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.204509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.230351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.230949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.231226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.231495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.232250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:19.232558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.234888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.256855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 366/747] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:19.257888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.287568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff233a25-4238-4b08-b431-66074ba50c8a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.328108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.329571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.330172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.330641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.331488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:19.332610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.334360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.348784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 382/748] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:19.350020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.369333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053255b9-1d7c-43d5-92f9-17e9485468a4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.404941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.406848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.407359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.407872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.421901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.423327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.430271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:19.438679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:19.439802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:19.440963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:19.440963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:19.440963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:19.442510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 367/749] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:19.443271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.460726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.473206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87103384-e0b3-4461-9f05-709fc36ffe09 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.514189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.514817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.515226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.515477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.527163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.528912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f4136326-58ac-473f-838a-c129ff8d3c59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:19.544729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:19.545723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:19.553186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:19.553186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:19.553186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:19.553186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 383/750] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:19.553459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a04acb3-06f9-4971-bafd-383437111083 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.553535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c502f-6e46-4e66-80d4-c52970eca375 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.553535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c502f-6e46-4e66-80d4-c52970eca375 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.553535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b25c502f-6e46-4e66-80d4-c52970eca375 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.553535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 384/751] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:19.553535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c502f-6e46-4e66-80d4-c52970eca375 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.589109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.589716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.589998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.590270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.596863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.598327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:19.610251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:19.611160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:19.612087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:19.616365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 368/752] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:19.617229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.672429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b25c502f-6e46-4e66-80d4-c52970eca375 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.684894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.708326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.708851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.709129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.709401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.710109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:19.710346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.711705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe4cd88-ca9c-4805-a1ca-b416fcbe66e2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.725111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 385/753] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:19.726819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.727104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.727378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.733850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.735527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bb4e33-250b-4f0c-b313-44a8fc9e1cb1 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.747027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:19.748250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:19.773401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.774090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.774372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.774649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.775285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:19.775590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.776985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.790066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 369/754] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:19.795257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.818178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 386/755] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:19 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:19.818838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:19.924259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6e7d54-0250-48a4-9696-d4017c0d4ee5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.944937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00264fbd-9458-4e36-9de0-a8bae28c0431 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:19.965524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.968961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:19.974181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.975889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.976697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.977140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.986857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.989075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:19.990440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:19.991268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:19.991642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:19.992010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:19.992916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:19.993315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:19.994846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:20.003097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:20.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:20.006078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:20.008972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 387/756] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:20.009953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.010451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 370/757] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:20.016849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.133620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a4e70a-223d-48ac-93eb-51b27da6a1b7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.135104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a36a5-de0d-4125-b6e3-8405fb0ceee4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.169520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.170147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.170426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.170700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.172472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.173071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.173594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.173707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.174412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:20.174669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.176221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.178198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.180434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:20.193314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:20.194171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:20.195055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 388/758] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:20.195525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.198107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 371/759] 10.222.0.72 () {56 vars in 1149 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:20.198882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.243488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:20.260748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:20.311564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2820c4f0-18de-435e-a351-ca6e1c57e343 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.315370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b79f54-f5d7-4d12-9cc2-6a0df8548e1b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.350359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.351300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.351589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.351942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.352882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=bb3a4609c413473ebfdda8bddedc631c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:20.353285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.354617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.354893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.355242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.355526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.355796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] PATH_INFO: `/v3/services/network` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.356470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.357820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.372071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 389/760] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/role_assignments?user.id=bb3a4609c413473ebfdda8bddedc631c&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:20.372071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:20.372336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:20.373240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:20.374049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 372/761] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/services/network => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:20.374824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.491761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:20.494979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca2b3ae-7be8-47bc-a346-db53424c85fe None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.495255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f5fed45-de7c-4a25-a899-d3f2e5611701 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.517473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:20.533887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.534492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.534841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.535215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.536104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:20.536405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.537850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.540173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.540939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.541392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.541806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.549673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 373/762] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:20.550619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.618879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.620365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.653189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ded30-aa92-423f-b21f-71c7d3a6490c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.690393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.691056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.691934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.692132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.692752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] RBAC: Adding query filter params (name=network) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:20.693055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.694410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bde968c-043a-4f02-b5a7-965fb89d7aaa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.703778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 374/763] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/services?name=network => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:20.703778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95149c-2090-4ded-af3f-a70b28075770 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.703778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95149c-2090-4ded-af3f-a70b28075770 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.703778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb95149c-2090-4ded-af3f-a70b28075770 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.703778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 375/764] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:20.703778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95149c-2090-4ded-af3f-a70b28075770 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.730751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:20.738142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 390/765] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:20.738142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.756145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:20.811771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb95149c-2090-4ded-af3f-a70b28075770 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.845349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c862db-193f-4492-8d88-b2f37dc98718 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:20.848357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d630e3-8a69-4fcc-bdc9-827dc7b2bd11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.849167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d630e3-8a69-4fcc-bdc9-827dc7b2bd11 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.849448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d630e3-8a69-4fcc-bdc9-827dc7b2bd11 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.849721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d630e3-8a69-4fcc-bdc9-827dc7b2bd11 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/a4e5a17f91134c59bec66f04a175ef05/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.851638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d630e3-8a69-4fcc-bdc9-827dc7b2bd11 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=a4e5a17f91134c59bec66f04a175ef05, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.853094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d630e3-8a69-4fcc-bdc9-827dc7b2bd11 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.869062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 376/766] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:20 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/a4e5a17f91134c59bec66f04a175ef05/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:20.870340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.870618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.870888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.890455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:20.891991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:20.902902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:20.903878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:20.904857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:20.905350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:20.906632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:20.907420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:20.909489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:20.919159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 391/767] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/services?type=network => generated 350 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:20.920424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:20.990285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 377/768] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:20 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:20.991433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.009240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.064462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.072547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703e7241-7e93-4598-a96c-0d7f011c5aad None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.112513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e9c828-bafe-4182-8031-5c8482229226 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.118950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.119654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.119996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.120356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.134121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.135900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.155936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:21.156626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:21.157740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:21.158714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:21.158714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:21.158714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:21.159442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.164344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 392/769] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:21.164438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.164438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.164438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] RBAC: Adding query filter params (interface=public, service_id=7596e76de92a4666bbbc6d0e5516b07d, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:21.164438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.164438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.168002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.180148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 378/770] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:20 2022] GET /identity/v3/endpoints?service_id=7596e76de92a4666bbbc6d0e5516b07d&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:21.185525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.325496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.326796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c15437-7fad-4963-ae3e-ae4ee7b085c5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.353035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b511df3-d1e3-4249-b00c-e62badfa0875 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.369667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.377570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.379248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.379737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.380468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.381571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:21.382501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.384732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.389942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.390549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.390828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.391098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.391959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.393337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.405814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 379/771] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/services => generated 772 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:21.405814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.406494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 393/772] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:21.414053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.606016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74074f25-94eb-4f62-8c91-efad6b528773 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.616217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2784b1d-dcea-46bf-b160-dfb017153466 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.649502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.650589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.651066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.651543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.652345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.654049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.663758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.664423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.664701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.664969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:21.665561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:21.666518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:21.667354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:21.670025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 380/773] 10.222.0.72 () {56 vars in 1129 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:21.673678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.676959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.679047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:21.692506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:21.693432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:21.694696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 394/774] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:21.695650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.699825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.766884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:21.848252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbcc95c-9ac6-4930-b52b-6ea9e30c0c47 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.858564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f509f288-c646-4fe2-9744-9ebe3aac24d0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:21.914560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.916245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.917066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.918016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.919296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:21.920244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.922119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.924513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:21.926052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:21.926552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:21.927681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:21.928611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:21.930076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:21.931716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:21.944065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 381/775] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:21.947914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:21.969356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 395/776] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:21.975092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:22.076755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:22.110885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7db10f1-a430-43ce-ae45-efe75df73d00 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:22.169617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bf3f75-a487-4e83-9a62-a00d35ffd98c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:22.182628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:22.183244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:22.183524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:22.183795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:22.184459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:22.184761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:22.186136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:22.200721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:22.201198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 382/777] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:22.213995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:22.242848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:22.243806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:22.244299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:22.244750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:22.247446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=2305c248866447d6a85fe63385ee12a5) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:22.247946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:22.249594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3162bd63-0979-42b5-aa3b-e0f4906d0785 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:22.264447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 396/778] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:21 2022] GET /identity/v3/role_assignments?user.id=2305c248866447d6a85fe63385ee12a5&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:22.359147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5038-3d5b-4ed3-8b87-5c8fe8c22220 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:22.359546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5038-3d5b-4ed3-8b87-5c8fe8c22220 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:22.359897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0f5038-3d5b-4ed3-8b87-5c8fe8c22220 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:22.362840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 397/779] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:22.367917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:22.368323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:22.368673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:22.398092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:22.399298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:22.439417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68342325-f4a7-475f-8e5e-f46b9c7cdc4b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:22.481095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:22.482084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:22.482566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:22.483048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:22.483966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] RBAC: Adding query filter params (interface=public, service_id=42a1e8e689294d6ebbfd4188a245f9f0, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:22.484637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:22.486345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:22.488674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:22.493633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 383/780] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:22 2022] GET /identity/v3/endpoints?service_id=42a1e8e689294d6ebbfd4188a245f9f0&interface=public®ion_id=RegionOne => generated 194 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:22.498973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:22.573713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 398/781] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:22 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:22.612405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99015623-6bd6-4408-ae6e-8b4f8d03073b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:22.650165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:22.651099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:22.651602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:22.652101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:22.652912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:22.654465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:22.661440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 384/782] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:22 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:22.932094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:23.044502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0edc72-67be-45c3-81e7-e457100ca6ab None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:23.052639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:23.080599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:23.081233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.081607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.081882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.092524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:23.097300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:23.098383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:23.099204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 399/783] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:23.104448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:23.185342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:23.227611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a22cc5-cf6f-473d-b5d3-8136a12412e9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:23.263901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:23.264922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.265404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.265874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.266999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:23.267530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:23.269209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013f41c6-1690-431c-8118-aa77c4c05a21 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:23.278885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 385/784] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:23.284374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:23.324512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a45d-47d4-4024-9d0c-3af6dd91a0d4 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.325168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a45d-47d4-4024-9d0c-3af6dd91a0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.325669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08a45d-47d4-4024-9d0c-3af6dd91a0d4 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.327412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 386/785] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:23.332767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.333400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.333942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.369174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:23.370360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:23.423727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4335735a-67ce-4b17-9ef8-aeca76fcaf57 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:23.494354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:23.494972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.495264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.495533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.500910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 387/786] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:23.513661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:23.515140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-075413c6-068b-4680-a933-6f556b0b669a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:23.530133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:23.531083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:23.531968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:23.531968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:23.531968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:23.531968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 400/787] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:23.537775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:23.630075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:23.687989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8b756e-9fa9-450e-85c1-a20fe23d2ad8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:23.725564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f24dab-8830-43d3-bb1d-caa4759ef01c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.725892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f24dab-8830-43d3-bb1d-caa4759ef01c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.726124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f24dab-8830-43d3-bb1d-caa4759ef01c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.727587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 401/788] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:23.737202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.737483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.737793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.739349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:23.740222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.740714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.741187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.742021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:23.742514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:23.744074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:23.757461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 388/789] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:23.763897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:23.777021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:23.778220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:23.806474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:23.869871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e12a3-0e94-47a8-8088-ebf93b01cb8d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:23.885142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:23.899060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 402/790] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:23 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:23.899922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:23.910638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:23.911395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:23.911770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:23.912191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:23.920318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:23.921862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:23.933893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:23.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:23.936237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 389/791] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:23.948149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.072851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd592b99-ca29-4a7f-8969-b5ca943ef7ed None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.127212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.127856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.128155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.128516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.148516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:24.153306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:24.154193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:24.155007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:24.156093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 403/792] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:24.162349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.169609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0781f8f3-4a5b-493f-8125-4b5f298cebbd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.180388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.234393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.235008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.235287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.235557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.236792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:24.236792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.238720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.261871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 390/793] 10.222.0.72 () {56 vars in 1135 bytes} [Thu Aug 25 02:48:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:24.263298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.302719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b04e753-8d2d-4810-94ab-c36ace722ee6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.307831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.341635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.342626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.343112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.343590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.344515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:24.345037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.346502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.355907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 404/794] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:24.356666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.401280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8764dc49-b552-4436-9db9-177b85099da5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.434476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.451412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.452580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.453402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.453892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] PATH_INFO: `/v3/services/network` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.454654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.457507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.469508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f8e132-f1c8-43f7-b384-3f1f045e3dbb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:24.470070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:24.471033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 25 02:48:24.471864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:24.479468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 391/795] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/services/network => generated 88 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:24.479468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.523384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.524395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.524877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.525345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.540691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.543178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:24.560277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:24.561247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:24.562551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:24.562551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:24.562551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:24.562551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 405/796] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:24.562785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.587186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.593985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3c7b3-f385-4318-8976-e8403a84a3a4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.628905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.629599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.629875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.630143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.641536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.642966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e7e58967-11ba-48b6-9fa4-406418845911 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:24.657721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:24.658712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:24.659651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:24.659651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:24.659651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:24.664186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 392/797] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:24.665436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df4a7-6279-4cf8-9413-8d28ff841aa0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.665717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df4a7-6279-4cf8-9413-8d28ff841aa0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.665987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6df4a7-6279-4cf8-9413-8d28ff841aa0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.667368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 393/798] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:24.667916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6df4a7-6279-4cf8-9413-8d28ff841aa0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.673931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906ec10-fa9b-440e-8be2-80a1f8b8cc39 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.698440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.711954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.712601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.712878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.713157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.713791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] RBAC: Adding query filter params (name=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:24.714090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.715478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.720252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 406/799] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/services?name=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:24.725015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.777339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6df4a7-6279-4cf8-9413-8d28ff841aa0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.813469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.814072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.814354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.814655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.815299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:24.815599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.818050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c49dc-a455-44fa-8409-bf2808178509 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.830147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 394/800] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:24.831344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.832393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.832678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.844995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dccc68d-c989-4b26-b2e4-5d58e2fc21ac None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:24.850611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:24.851799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:24.854034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:24.886773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:24.887372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:24.887647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:24.887922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:24.888593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:24.888892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:24.891474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:24.905188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 407/801] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:24.906007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.928723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 395/802] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:24.929920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:24.977214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.038516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52721fa-b1be-4b75-b848-61b82b0d253f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.070850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afc6792-5991-4d6c-a406-c7f7303079dd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.077169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107332a1-e695-4417-a822-aba018184af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.077788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107332a1-e695-4417-a822-aba018184af4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.078066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107332a1-e695-4417-a822-aba018184af4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.078338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107332a1-e695-4417-a822-aba018184af4 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.078977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107332a1-e695-4417-a822-aba018184af4 None admin] RBAC: Adding query filter params (type=network) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:25.079278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107332a1-e695-4417-a822-aba018184af4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.080679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107332a1-e695-4417-a822-aba018184af4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.090566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 408/803] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:25.090566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107332a1-e695-4417-a822-aba018184af4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.111207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.111796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.112157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.112459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.120207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.121734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.123559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:25.135339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:25.136326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:25.137206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:25.140169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 396/804] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:25.140980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.205378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107332a1-e695-4417-a822-aba018184af4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.218024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.245097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.245719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.246002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.246273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.252663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f7ef58-2681-4af0-8d28-0c6b47054916 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.254011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.255443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:25.267868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:25.269062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 409/805] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:25.270712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.289529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac081a0-ce07-4496-bfe4-4c41b8791b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.290135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac081a0-ce07-4496-bfe4-4c41b8791b63 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.290414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac081a0-ce07-4496-bfe4-4c41b8791b63 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.290687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac081a0-ce07-4496-bfe4-4c41b8791b63 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.291577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac081a0-ce07-4496-bfe4-4c41b8791b63 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.292792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac081a0-ce07-4496-bfe4-4c41b8791b63 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.316664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 397/806] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:25 2022] POST /identity/v3/endpoints => generated 337 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:25.318104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9738e-badb-47fe-b877-e28511bc8ee1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.318394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9738e-badb-47fe-b877-e28511bc8ee1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.318667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b9738e-badb-47fe-b877-e28511bc8ee1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.324198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 398/807] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:25.324198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9738e-badb-47fe-b877-e28511bc8ee1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.388460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.390950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b99bf-abdf-4f64-8801-ea77544bce27 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.436011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.436753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.437029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.437299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.438028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:25.438333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.439812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.446864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b9738e-badb-47fe-b877-e28511bc8ee1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.458794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 410/808] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:25.458794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.489895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.494946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803182e6-5f70-471c-9a05-1d6b56977ba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.497175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803182e6-5f70-471c-9a05-1d6b56977ba6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.497175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803182e6-5f70-471c-9a05-1d6b56977ba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.497175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803182e6-5f70-471c-9a05-1d6b56977ba6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.509463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803182e6-5f70-471c-9a05-1d6b56977ba6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-803182e6-5f70-471c-9a05-1d6b56977ba6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:25.515069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:25.515998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:25.517115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:25.518041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 399/809] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:25.520275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.520585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.520833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.539986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:25.541186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:25.574235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e85deeb-3733-4be6-823b-7ffb1c89ab26 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.606748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 400/810] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:25 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:25.607661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.614362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.614969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.615249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.615520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.616286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:25.616592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.618015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.641422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 411/811] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:25.641422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.662954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.721179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88b7568-5a82-4d67-8850-8f3e8c4d21ee None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.735080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.750999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e22600-02e3-45be-b22b-80e1764b7f5b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.761930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.762928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.763382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.763944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/bb3a4609c413473ebfdda8bddedc631c/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.765863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=bb3a4609c413473ebfdda8bddedc631c, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.767795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.782252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 401/812] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:25 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/bb3a4609c413473ebfdda8bddedc631c/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:25.783070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.799059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.800282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.800893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.801416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.802307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:25.802942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:25.804846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:25.820652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 412/813] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:25.822483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:25.900141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49033f3-619a-4d0c-9782-a28c91bf3305 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.903362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:25.948073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef86371d-1a0b-410c-94fd-447b561bdaa4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:25.956942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.957823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.958254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.959015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:25.990739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:25.991672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:25.992169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:25.992623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.006465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.008269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.015533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:26.026219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:26.027169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:26.028060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:26.028060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:26.028060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:26.028060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 413/814] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:26.028305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.032851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.034298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.142206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fb1635-df37-481b-8e9b-d925c1989e8f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.144629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 402/815] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:25 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:26.145764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.150261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.180112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.180745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.181028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.181303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.181892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.183262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:26.192405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:26.193557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:26.194846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 414/816] 10.222.0.72 () {56 vars in 1129 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:26.195633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.257786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d7dc89-81ec-43e1-beed-65b84941818b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.261245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.295930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.296635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.296918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.297188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.297835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:26.298138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.299495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.317731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 403/817] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:26.317925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305f72d9-89e2-4710-b7fa-655a0a849cfc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.318046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.354503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.355119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.355401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.355670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.366639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.368138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:26.382999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:26.383933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:26.384829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:26.384829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:26.384829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:26.384829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 415/818] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:26.385721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.389204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.431432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8ed195-18d9-45e2-b535-27485a487819 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.467965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.468602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.468879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.469407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.469767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:26.470064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.471417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.476097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 404/819] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:26.481278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.494948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadba615-0a80-4390-84ac-30e0e6474bb3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.509439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.531715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.532365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.532642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.532912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.540592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.542012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:26.553173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:26.554113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 416/820] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:26.555111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.599481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173cef87-abea-4048-ac51-0a59d06333bb None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.627966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.636984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.637582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.637860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.638131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.638770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:26.639068 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.640459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.654420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 405/821] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:26.655116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.669119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7520b6c-7f87-4973-86d9-fee6fd431f3d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.712857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.713390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.713683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.713938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.714564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:26.714860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.716233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.725950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 417/822] 10.222.0.72 () {56 vars in 1124 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:26.725950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.762106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d38aa7-22c1-48c3-a8a5-817cf6487448 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.770075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.798571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.799339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.799451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.799708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.801207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:26.801514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.803001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.822030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 406/823] 10.222.0.72 () {56 vars in 1149 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:26.822673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:26.840908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae90d5c4-138e-496d-b660-76271fe084cd None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.870286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:26.879048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.879893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.880221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.880497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.888119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.889871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:26.930452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6952aa91-a4b9-4c93-97ef-cd8e88193f54 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:26.976580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:26.977195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:26.977478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:26.977756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:26.978489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:26.979876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.016290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 407/824] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:26 2022] POST /identity/v3/endpoints => generated 346 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:27.016290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:27.020884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:27.022023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:27.023126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 418/825] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:27.029967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.144205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.163722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a59422c-93f4-45b1-9a32-d73f8a9d4e67 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.169413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.174500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcebbb-3ef5-4ece-8cfd-bae363d9c1f1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.220438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.221197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.222599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.222599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.226284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.227161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.227639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.228183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.229086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:27.229574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.231912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.235939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.237439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.248319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 419/826] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:27.254979 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:27.256196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:27.257327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:27.258240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:27.258240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:27.258240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:27.258240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 408/827] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:27.264136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.378547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29d32ca-56b6-4647-a3ff-4551307ac023 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.392726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef8e4851-3ff9-45bf-ab55-e46ba8476a0d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.418018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.418628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.418905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.419173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.419816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:27.420143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.421494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.440130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 409/828] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:27.443598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.451134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.452256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.452745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.453218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.454716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=a4e5a17f91134c59bec66f04a175ef05) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:27.455237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.458033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.459896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.469102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 420/829] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/role_assignments?user.id=a4e5a17f91134c59bec66f04a175ef05&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:27.571545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2feb0e3-16af-4984-961e-5232b7a1af7f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.610487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.611460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.611926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.613112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.620979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.622811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-16902373-371a-43cb-8ef9-e9ed18ab5e27 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:27.635841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:27.636807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:27.637988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 410/830] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:27.645582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.674556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.753661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e44e6-e161-4c01-bfba-0d07ffe26b0e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.753988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e44e6-e161-4c01-bfba-0d07ffe26b0e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.754211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41e44e6-e161-4c01-bfba-0d07ffe26b0e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.755801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 411/831] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:27.760281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86767d09-4ece-4ba9-be39-fc27fa0fd165 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.761459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.761967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.762440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.782249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:27.783577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:27.801042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.801845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.802125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.802399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.803208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:27.803519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.805093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:27.818846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 421/832] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:27.825128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:27.856332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.861160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 412/833] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:27 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:27.916630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:27.937418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8c1d56-a614-4371-9058-f0af1c0ff197 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:27.973330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:27.973997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:27.974275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:27.974552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/2305c248866447d6a85fe63385ee12a5/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:27.991560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=2305c248866447d6a85fe63385ee12a5, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:27.993042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:28.010815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 422/834] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:27 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/2305c248866447d6a85fe63385ee12a5/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:28.142218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:28.246773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645e80c0-bfc9-4f74-b1f6-65ff2174cbc4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:28.284077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:28.284854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:28.285136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:28.285408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:28.295779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:28.302574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:28.303760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:28.304825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 413/835] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:28.309129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:28.419596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bb968d-f99e-4250-983d-d4ddbacba63e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:28.454000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:28.460618 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:28.461524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:28.461956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:28.462228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:28.462899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:28.463201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:28.464602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:28.474222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 423/836] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:28.479888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:28.543167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:28.586443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2514dc88-7441-4cbe-a453-bda448e9a1d2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:28.622240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:28.622871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:28.623148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:28.623418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:28.634746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:28.636228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:28.651964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:28.652963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:28.653839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:28.653839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:28.653839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:28.653839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 414/837] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:28.658996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:28.767938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f788e85-0606-4178-8311-029c307cb1c5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:28.805134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:28.805755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:28.806035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:28.806309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:28.806974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:28.807277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:28.808787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:28.822686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 424/838] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:28.828259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:28.934668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662142c0-e539-44c9-8eba-c10d1f5f7fea None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:28.952407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:28.971128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:28.971755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:28.972702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:28.972975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] PATH_INFO: `/v3/users/swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:28.980772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:28.982208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d1b1b3a4-f29c-43ac-b2da-f0088371f1de None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:28.994273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:28.995208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:28.996197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 415/839] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:29.001075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.060766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.111944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce78431-f6fd-48f5-a358-aff5f28251e6 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:29.150802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:29.151415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.151693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.151965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.152749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:29.153054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:29.153525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5e57-bc2c-4c35-bf27-d42f5625c486 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.153807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5e57-bc2c-4c35-bf27-d42f5625c486 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.154081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5e57-bc2c-4c35-bf27-d42f5625c486 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.154483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:29.159112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 416/840] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:29.161102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.161387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.161662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.174113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 425/841] 10.222.0.72 () {56 vars in 1135 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:29.179994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.184713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:29.185958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:29.261715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 417/842] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:29.288924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c79881-faf6-45e1-b6cb-9220f35f3ba5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:29.302661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.325728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:29.326269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.326551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.326828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.398598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:29.400074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:29.503191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 426/843] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:29.508734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.559566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.579506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.624698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da2b77dd-6348-41ca-80db-d2cce2f8cdb1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:29.626369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.666470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:29.667112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.667396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.667674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.679601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:29.681056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:29.698022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:29.699037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:29.699926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:29.699926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:29.699926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:29.699926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 418/844] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:29.704793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.712933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04029f3d-94d5-4408-b987-98cbc3825457 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:29.751066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:29.751704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.751985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.752297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.752887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:29.755135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a0b58e0b-477e-40af-be21-259ebf0c6ad3 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:29.764884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:29.765866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:29.766954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 427/845] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:29.767740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd913-e6c7-45c7-a5af-87befc2b41b4 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.767740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd913-e6c7-45c7-a5af-87befc2b41b4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.768240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19dd913-e6c7-45c7-a5af-87befc2b41b4 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.770362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 428/846] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:29.774891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dd913-e6c7-45c7-a5af-87befc2b41b4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.822281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc37c432-5799-415e-82a8-bce8c307bcb2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:29.857798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:29.858450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.858682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.858940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.859576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:29.859879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:29.860156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.861269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e92548-ba90-4c4b-a460-e22f895795f8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:29.874693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 419/847] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:29.875776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.876149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.876365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.890291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19dd913-e6c7-45c7-a5af-87befc2b41b4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:29.896842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:29.898032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:29.907587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:29.927804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:29.928442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:29.928716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:29.928985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:29.929609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:29.929903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:29.931254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:29.940077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 429/848] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:29.940077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:29.981500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 420/849] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:29 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:29.982429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.056344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcdc3187-3ad0-4c37-9978-e3b7ca9182f9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.086761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f46cd9e3-5f8b-4581-b6cb-92b330cdc9b3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.095053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.095895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.096339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.096939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.104675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.106416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.109450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c2b7c8e1-ec16-4ddc-9e6d-596c7353df2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:30.121821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:30.122731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:30.123664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:30.127812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 430/850] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:30.128671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.129686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.130116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7acfbc-f55d-487a-abed-7d4b2dc28eb7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.130401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7acfbc-f55d-487a-abed-7d4b2dc28eb7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.130638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.130759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7acfbc-f55d-487a-abed-7d4b2dc28eb7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.130931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.131556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:30.131858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.133359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf25daf-c624-466e-bcd5-161417aedf80 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.135723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 431/851] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:30.136403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7acfbc-f55d-487a-abed-7d4b2dc28eb7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.138673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 421/852] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:29 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:30.140917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.140917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.140917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.162049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:30.163265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:30.166549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.238985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 422/853] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:30 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:30.257051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.285421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7acfbc-f55d-487a-abed-7d4b2dc28eb7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.333095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.333792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.334145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.334484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.335264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:30.335636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.337174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.350140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 432/854] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:30.357430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.391714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751c7826-5abd-495f-a5d6-47eb5adacfb2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.436310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.437442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.437759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.438091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.438884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.439916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.441901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:30.453978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:30.454904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:30.455811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:30.459569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 423/855] 10.222.0.72 () {56 vars in 1132 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:30.464961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.468928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.493947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3278a-652c-44b9-bb91-fa361eae01b7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.535743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.536395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.536678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.536955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.537702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=bb3a4609c413473ebfdda8bddedc631c) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:30.537999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.539429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.545608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 433/856] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/role_assignments?user.id=bb3a4609c413473ebfdda8bddedc631c&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:30.546406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.597482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a027cd-cb54-4697-9bad-b26201632ebc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.645966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.646681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.647157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.647489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.648236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:30.648605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.650135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.655702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 424/857] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:30.664793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.687002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc14aa-6f10-4b40-b6f7-b0dfbcfceaee None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.718556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.734599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.735505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.735791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.736102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.745614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:30.749345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:30.754609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:30.755697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:30.756701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 434/858] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:30.761794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:30.790690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b524d9c5-ed19-48d7-b4c6-ee7e7d2a4736 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.839862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.840511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.840792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.841296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.841937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:30.842247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.844443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.851454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 425/859] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:30.887025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dbaad3-a390-45bd-817a-9ca503854683 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:30.928266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:30.929129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:30.929573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:30.929990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:30.930833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:30.931289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:30.932867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:30.942852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 435/860] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:30.949256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:31.068756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f304f49-8fbd-425c-83ab-37e1297e1783 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:31.097875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:31.104631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:31.105618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:31.105895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:31.106163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:31.118020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:31.119469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:31.134158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:31.135124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:31.136007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:31.136007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:31.136007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:31.136007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 426/861] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:31.141277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:31.195558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:31.255434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef026eba-a238-4d9b-aa14-39f1a941391e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:31.292653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:31.293267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:31.293549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:31.293824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:31.294479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:31.294782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:31.296197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:31.309662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 436/862] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:31.314907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:31.424740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4163e643-04bf-4cbc-b157-2a28d3a2c153 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:31.460217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:31.460780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:31.461064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:31.461341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:31.468820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:31.470244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:31.482088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:31.484227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:31.486454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 427/863] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:48:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:31.493142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:31.598529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6496d091-1dea-4fc4-998e-9f863080e041 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:31.612440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:31.633897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:31.634503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:31.634778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:31.635047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:31.635782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:31.636110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:31.637533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:31.657209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 437/864] 10.222.0.72 () {56 vars in 1149 bytes} [Thu Aug 25 02:48:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:31.662629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:31.708312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:31.770429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa4aecc-c96a-4920-959b-2d94e1450920 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:31.805436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:31.806040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:31.806316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:31.806585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:31.876213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:31.877662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:31.932812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:31.979683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 428/865] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:31 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:31.985178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.089715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127ca50b-774c-406b-a5be-76c774c6bbde None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.132783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.133422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.133699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.133971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.145027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.146453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-74c2c9b9-9959-4f1f-9adb-9bb132b92daf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:32.161134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:32.162078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:32.162964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:32.162964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:32.162964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:32.162964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 438/866] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:32.167919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.271100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b48ea11-72c7-4f3c-8fb2-8af6e24f87c3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.287154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45770a8c-b1ec-410a-b970-6015972a9468 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.287467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45770a8c-b1ec-410a-b970-6015972a9468 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.287695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45770a8c-b1ec-410a-b970-6015972a9468 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.290491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 439/867] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:32.294623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.294901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.295276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.307181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.307793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.308087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.308366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.309568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:32.309870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.311527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:32.314313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:32.316249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:32.328918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 429/868] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:32.333400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:32.334854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.339168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:32.413946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 440/869] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:32.462431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660fff5c-dc02-49b3-b5f0-a6fcd20dbccc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.496413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.497039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.497318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.497578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.505026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.506413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-94dc3b73-5d55-4707-9c6c-883014fcdbce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:32.517848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:32.518877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:32.520646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 430/870] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:32.527285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.632165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4a5bd-d756-4d23-9d49-ed42d3817371 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.642655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ac5d-6057-4095-9590-9ca65721aed1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.642910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ac5d-6057-4095-9590-9ca65721aed1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.643180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4ac5d-6057-4095-9590-9ca65721aed1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.645369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 431/871] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:32.650975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.651259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.651532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.671347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.672370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.672878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.673339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.673556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:32.674414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:32.674761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:32.675274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.677264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:32.698080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 441/872] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:32.698080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.705985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:32.749171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:32.768074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 432/873] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:32 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:32.768074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:32.806433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea862de-8fcb-47d4-8753-543f81bd511c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.848258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f3f8e4-4e47-4120-b56a-c704016e5060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.849405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3f8e4-4e47-4120-b56a-c704016e5060 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.849824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3f8e4-4e47-4120-b56a-c704016e5060 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.850100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f3f8e4-4e47-4120-b56a-c704016e5060 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.850753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3f8e4-4e47-4120-b56a-c704016e5060 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.852149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f3f8e4-4e47-4120-b56a-c704016e5060 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:32.870330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 442/874] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:32 2022] POST /identity/v3/services => generated 251 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:32.872931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165a5e-b270-45f3-b66b-4e3d35c43c3c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.873225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165a5e-b270-45f3-b66b-4e3d35c43c3c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.873488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3165a5e-b270-45f3-b66b-4e3d35c43c3c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.875120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 443/875] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:32.881651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.882020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.882419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.907848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b258ee46-b9a4-41b5-89a2-f195794df36d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:32.909070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:32.912743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:32.969727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:32.970674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:32.971132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:32.971582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:32.973236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=2305c248866447d6a85fe63385ee12a5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:32.973756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:32.975463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:32.988553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 433/876] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:32 2022] GET /identity/v3/role_assignments?user.id=2305c248866447d6a85fe63385ee12a5&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:32.999665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:33.002274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 444/877] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:32 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:33.044636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:33.117183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:33.165494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756e9e1e-8684-4ccf-af7a-c6eca1411fed None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:33.201897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:33.202463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:33.202746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:33.203066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:33.203662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:33.205114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:33.215113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:33.216170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:33.216988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 434/878] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:33 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:33.223129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:33.293966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:33.336754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373a90f3-b569-4488-ba1d-26b1337fb18c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:33.378069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:33.378736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:33.379015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:33.379283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:33.379925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:33.380258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:33.381688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:33.389106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 445/879] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:33 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:33.395097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:33.413439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07985465-3183-49b5-a763-3c4e1faccc04 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:33.434801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:33.456216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee55a358-5ac9-4f0c-8b4d-a56c7ea88d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:33.457186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a358-5ac9-4f0c-8b4d-a56c7ea88d14 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:33.457557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a358-5ac9-4f0c-8b4d-a56c7ea88d14 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:33.457929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee55a358-5ac9-4f0c-8b4d-a56c7ea88d14 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:33.458669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a358-5ac9-4f0c-8b4d-a56c7ea88d14 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:33.460154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee55a358-5ac9-4f0c-8b4d-a56c7ea88d14 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:33.478643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 435/880] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:33 2022] POST /identity/v3/services => generated 269 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:48:33.483571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:33.537964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0d953-9c51-452c-855d-b63fa3383100 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:33.585983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:33.586610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:33.586891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:33.587162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:33.587809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:33.588142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:33.589542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822342bc-bdf2-43b7-b8a1-a37ebbc4ae74 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:33.595106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 446/881] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:33 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:34.868095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164098d6-ece2-4ecd-9694-ec626b031d16 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:34.868613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164098d6-ece2-4ecd-9694-ec626b031d16 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:34.868691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164098d6-ece2-4ecd-9694-ec626b031d16 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:34.870226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 436/882] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:34.875634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746896-7ccf-483a-8a63-94bcfde8e765 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:34.876103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746896-7ccf-483a-8a63-94bcfde8e765 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:34.876202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd746896-7ccf-483a-8a63-94bcfde8e765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:34.897368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cd746896-7ccf-483a-8a63-94bcfde8e765 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:34.898904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cd746896-7ccf-483a-8a63-94bcfde8e765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:34.976160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 447/883] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:34 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:35.101592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d073-0aba-4939-800e-20ada21dd9dc None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.101919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d073-0aba-4939-800e-20ada21dd9dc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.102149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb39d073-0aba-4939-800e-20ada21dd9dc None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.103610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 437/884] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:35.112053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.112053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.112053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.129373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:35.130856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:35.179504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:35.202273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 448/885] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:35.247819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39d073-0aba-4939-800e-20ada21dd9dc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.363173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb39d073-0aba-4939-800e-20ada21dd9dc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.399976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.400561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.400841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.401115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.401701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:35.403059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:35.412936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:35.413918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:35.415036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 438/886] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:35.422154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.492639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.526162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0791e5fa-9781-49a0-83f2-d0fa619f394f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.537918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:35.562351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.562952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.563224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.563491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.564172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:35.564472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:35.565982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d4d4712-e919-4273-a80b-3c4ac592c996 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:35.571251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 449/887] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:35.572406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f9b4-354c-4487-8736-2930adcfb11c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.572683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f9b4-354c-4487-8736-2930adcfb11c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.572949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a1f9b4-354c-4487-8736-2930adcfb11c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.574286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 450/888] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:35.575119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb880-bfd4-4171-9fe0-484c1b25863d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.575449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb880-bfd4-4171-9fe0-484c1b25863d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.575720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd4eb880-bfd4-4171-9fe0-484c1b25863d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.576988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 451/889] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:35.577665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb880-bfd4-4171-9fe0-484c1b25863d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.603414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d10daa-321b-4665-ab34-9b0bbe95f24c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.627978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:35.636804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cecadde-8f51-4de2-9102-289926d9dc34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.637426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecadde-8f51-4de2-9102-289926d9dc34 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.637706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecadde-8f51-4de2-9102-289926d9dc34 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.637977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cecadde-8f51-4de2-9102-289926d9dc34 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.649020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cecadde-8f51-4de2-9102-289926d9dc34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0cecadde-8f51-4de2-9102-289926d9dc34 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:35.654194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:35.655266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:35.656301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 439/890] 10.222.0.72 () {56 vars in 1120 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:35.656985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.656985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.656985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.674689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:35.675972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:35.686249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd4eb880-bfd4-4171-9fe0-484c1b25863d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.720258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.720860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.721140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.721413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.722647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:35.722948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:35.724343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b5b86f-2a5a-4642-ba37-7b11e95b7aca None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:35.729320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 452/891] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:35.730516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.730802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.731077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.743220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 440/892] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:35.744293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.757136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:35.758506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:35.774915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:35.827321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 453/893] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:35 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:35.828612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.853215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d1d906-69f1-43fa-b827-79a5a2d78b0e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.883024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:35.901328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.903048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.903506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.903924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.905085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:35.905890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:35.907955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:35.920764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 441/894] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:35.925904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:35.949690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffe67ed-561e-4f92-aac8-e2ce8d34fb96 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:35.987710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:35.988504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:35.988877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:35.989302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:35.990273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] RBAC: Adding query filter params (interface=public, service_id=e925d6cd9bfb49e5b0dc6921686e7dc4, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:35.990485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:35.991941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:35.999776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 454/895] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/endpoints?service_id=e925d6cd9bfb49e5b0dc6921686e7dc4&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:36.005799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.046827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.057607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb66bba-bfed-4411-a0cd-45444a59a515 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.094087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a376-6758-487f-824e-f04996812e9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.094806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a376-6758-487f-824e-f04996812e9f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.095093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a376-6758-487f-824e-f04996812e9f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.095362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6272a376-6758-487f-824e-f04996812e9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.107572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a376-6758-487f-824e-f04996812e9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.109043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6272a376-6758-487f-824e-f04996812e9f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.113473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dfba62-41a1-40c1-ae42-9f3b7b5219ce None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.115027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6272a376-6758-487f-824e-f04996812e9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:36.124512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:36.125530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:36.126377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:36.126377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:36.126377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:36.126550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 442/896] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:36.127200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a376-6758-487f-824e-f04996812e9f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.149877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.150484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.150764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.151037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.151639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.153032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.158723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 455/897] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/services => generated 1268 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:48:36.159561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.254348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6272a376-6758-487f-824e-f04996812e9f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.283879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a2868a-70b7-48cc-873a-ba482a6421e4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.299137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.300851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.300851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.301064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.301519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.302881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:36.311983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:36.313037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:36.313935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 443/898] 10.222.0.72 () {56 vars in 1132 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:36.314706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.325654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.331239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.331869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.332171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.332474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.333128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.334550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.352764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 456/899] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:36 2022] POST /identity/v3/services => generated 241 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:36.353674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.401096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.447088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b36c7304-ff46-4bce-8679-a55e350a144c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.504139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.504767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.505042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.505312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.505960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:36.506258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.507952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.508300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b1fa3a-de17-47f4-ad1f-74a849f21ca2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.523079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 444/900] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:36.529239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.556124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.557105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.558090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.558574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.559403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:36.559710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.562660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.568766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 457/901] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:36.575216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.609197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.662203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a0ec83-db9c-4b6c-aba8-f93191e726e2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.685732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.707390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90fd23b6-caf1-4699-9669-d1e114318f69 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.711639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.712370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.712655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.712982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.723986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.726227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:36.742501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:36.743492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:36.744962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:36.747621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 445/902] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:36.749283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.756744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.757356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.757635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.757905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.758616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:36.758932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.760442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.767734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 458/903] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:36.773429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.892347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6095e7d8-924b-423c-9e8c-5f6f2567a85e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.918184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11605b08-36e0-41d7-97f0-54c54a65ed20 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:36.926860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:36.952143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.953075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.953581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.954068 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.955307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:36.956198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.958811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.969400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:36.970091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:36.970438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:36.970780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:36.972632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] RBAC: Adding query filter params (interface=public, service_id=adf4b21d3fdd44918782dacf29d83815, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:36.973082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:36.974460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:36.990548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 459/904] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/endpoints?service_id=adf4b21d3fdd44918782dacf29d83815&interface=public®ion_id=RegionOne => generated 194 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:36.990721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 446/905] 10.222.0.72 () {56 vars in 1149 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:36.992360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:36.992806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:37.014157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:37.103905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37de9940-3570-4403-b852-8460a9d47e14 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:37.124011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b000f8-a252-4abb-ae14-9adf77d28fdf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:37.151362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:37.151974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:37.152284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:37.152558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:37.153166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:37.155233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:37.163404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 447/906] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/services => generated 1497 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:48:37.163820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:37.164858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:37.165347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:37.165824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:37.250361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:37.252242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:37.270837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:37.371123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 460/907] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:36 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:48:37.377014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:37.427191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:37.483356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70fc9ee-8181-4204-9df6-3cbc9a2694c0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:37.519424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:37.520087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:37.520386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:37.520661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:37.532438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:37.533949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:37.549813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:37.550954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:37.552435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:37.552435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:37.552435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:37.552435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 448/908] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:37.557308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:37.665384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60380c96-7d55-42d9-962c-97b286714d16 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:37.682680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:37.705479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:37.706128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:37.706410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:37.706684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:37.707341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:37.707643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:37.709048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:37.721235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 461/909] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:37.727413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:37.835451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:37.839316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ec4351-9bb1-430b-b7d1-5372333dea06 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:37.876055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:37.876709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:37.876984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:37.877259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:37.884923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:37.886368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:37.899844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:37.902042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:37.904101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 449/910] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:37.906912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:38.016098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7dc51c-1dae-4053-b180-f6542c54eec3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:38.052639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:38.053233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.053515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.053789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.054484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:38.054792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:38.056251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a57891-569d-4459-8b85-059029bf5040 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:38.069068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 462/911] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:38.077126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:38.186960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a7d09-d251-4183-baa0-0ea6e54ef0c0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:38.200085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1fde-0ba2-4ae1-b2c4-6d48542f1234 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.200085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1fde-0ba2-4ae1-b2c4-6d48542f1234 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.200085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea1fde-0ba2-4ae1-b2c4-6d48542f1234 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.202565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 463/912] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:38.207314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad0ed-afbc-49db-b42a-cdf151459640 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.207842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad0ed-afbc-49db-b42a-cdf151459640 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.208458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cad0ed-afbc-49db-b42a-cdf151459640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.222404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:38.223012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.223292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.223562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.224316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] RBAC: Adding query filter params (role.id=4cec4b90840b45179679e5a71a51d668, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=2305c248866447d6a85fe63385ee12a5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:38.224624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:38.226067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a06ba9-29f5-4293-87e1-0ddedf7ecc7d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:38.232246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 450/913] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:38 2022] GET /identity/v3/role_assignments?user.id=2305c248866447d6a85fe63385ee12a5&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=4cec4b90840b45179679e5a71a51d668 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:38.232721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-91cad0ed-afbc-49db-b42a-cdf151459640 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:38.233990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-91cad0ed-afbc-49db-b42a-cdf151459640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:38.264937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:38.324277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 464/914] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:38.423980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3eef0-de2d-461a-ba5d-e4a896ba6f76 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.424318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3eef0-de2d-461a-ba5d-e4a896ba6f76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.425266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f3eef0-de2d-461a-ba5d-e4a896ba6f76 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.427172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 451/915] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:38.433713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.433999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.434274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.452880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:38.453980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:38.523465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 465/916] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:38 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:38.603512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3eef0-de2d-461a-ba5d-e4a896ba6f76 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:38.631370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:38.713408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f3eef0-de2d-461a-ba5d-e4a896ba6f76 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:38.748925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:38.749551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.749879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.750152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.750780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:38.752169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:38.761198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:38.762232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 25 02:48:38.763064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:38.767514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 452/917] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:38 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:38.769761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:38.810129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:38.884211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:38.894012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2304c4ea-8499-4724-afb3-b9dcd4ec9ec4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:38.913379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:38.931577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e980bd-5dfc-4480-8b38-67dd079cb9ff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:38.943509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:38.944157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.944439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.944714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.945357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:38.945660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:38.947023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:38.956360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 466/918] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:38.968150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:38.984061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:38.984692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:38.984972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:38.985244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:38.985822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:38.987436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:38.996519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:38.997508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:38.998363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 453/919] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:39.005663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.087526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3649d10f-cd77-4d11-9e48-2f1bf1223c79 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.122979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4309caa5-42c4-427c-86c2-a2cc7dbdaa4b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.134481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.135100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.135382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.135657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.136328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:39.137042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.138719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.145924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 467/920] 10.222.0.72 () {56 vars in 1114 bytes} [Thu Aug 25 02:48:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:39.152320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.169353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.169815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.170093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.170413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.171093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:39.171331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.172729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.182644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 454/921] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:39.183557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.185371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:39.204965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:39.271887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fcbb259-2398-4ad4-a6c6-b14e5d543729 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.307538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920b5c2-e46d-4413-9b91-1e665e46a26a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.308179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b5c2-e46d-4413-9b91-1e665e46a26a None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.308458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b5c2-e46d-4413-9b91-1e665e46a26a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.308735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920b5c2-e46d-4413-9b91-1e665e46a26a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.309397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b5c2-e46d-4413-9b91-1e665e46a26a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.310772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920b5c2-e46d-4413-9b91-1e665e46a26a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.311148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca79d5d-429d-494a-a42b-85502226806d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.335050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 468/922] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:39 2022] POST /identity/v3/endpoints => generated 346 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:39.336451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9130-e406-4095-9d2a-e1752c400f65 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.336718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9130-e406-4095-9d2a-e1752c400f65 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.336995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9d9130-e406-4095-9d2a-e1752c400f65 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.342339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 469/923] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:39.344241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.344417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.344691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.373477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.374073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:39.374841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.375305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.375425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:39.375858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.376762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:39.377284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.379150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.386050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 455/924] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:39 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:39.392612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.466705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 470/925] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:39 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:39.482721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:39.511963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcb7c1-c2d9-4b55-b9b5-bf9cc6e64df0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.548356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.548981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.549319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.549693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.550469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] RBAC: Adding query filter params (interface=public, service_id=cc8d1ff154d64dab8a697b60d5c247f6, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:39.550853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.552389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.557839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 456/926] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:39 2022] GET /identity/v3/endpoints?service_id=cc8d1ff154d64dab8a697b60d5c247f6&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:39.563738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.575530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:39.675171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87294d45-8ac4-45b6-8988-a6ee33370fb2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.711507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.712240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.712588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.712927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.713620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.715062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.722299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 471/927] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:39 2022] GET /identity/v3/services => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:48:39.742439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.855581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683d2921-25e6-459c-8277-1fa5d33798f3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:39.892963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:39.895212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:39.895212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:39.895563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:39.896562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:39.897802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:39.907002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:39.908183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:39.909761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 457/928] 10.222.0.72 () {56 vars in 1132 bytes} [Thu Aug 25 02:48:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:39.914461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:39.995265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.026402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a5e4a-0b71-478d-8931-b16c3be0d271 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:40.059960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:40.060598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.060875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.061144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.061769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:40.062069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:40.063415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2867c8-aca4-4fa8-be84-ae397cbb71aa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:40.068973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 472/929] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:39 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:40.074603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:40.078064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.181405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85597152-4099-42a5-8626-62ca3489ed84 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:40.217392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:40.217995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.218269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.218540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.219161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:40.219461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:40.220846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:40.226736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 458/930] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:40.231991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313ea88-287a-4509-be9b-d81e2070a173 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.232493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313ea88-287a-4509-be9b-d81e2070a173 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.232591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2313ea88-287a-4509-be9b-d81e2070a173 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.233967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 473/931] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:40.235575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:40.240336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.240610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.240880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.260951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:40.262134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:40.309478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.340067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 474/932] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:40 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:40.353145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1b1855-8ff6-40fd-8ecc-fcac7cb8047e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:40.389325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:40.389990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.390325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.390604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.391507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:40.392898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:40.415591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 459/933] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:40 2022] POST /identity/v3/endpoints => generated 347 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:40.632395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:40.700216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.736388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5844a028-b21e-45ba-b0eb-8b346f5cd9ad None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:40.777386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:40.778021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.778302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.778637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.790574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:40.795284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:40.796259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:40.797513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 475/934] 10.222.0.72 () {56 vars in 1120 bytes} [Thu Aug 25 02:48:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:40.805245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:40.920018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283df413-acdb-44ad-a13f-17b7ebc95c0e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:40.954352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:40.968253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:40.968861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:40.969140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:40.969413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:40.970086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:40.970389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:40.972561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:40.981547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 460/935] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:48:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:40.989142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:41.099048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c56a71-887d-40ef-a223-033507dfead1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:41.133589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:41.151030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:41.151918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.152589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.153040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.178607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:41.180283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d463e62c-06b4-468e-a9c5-2e328c9e7391 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:41.208790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:41.209827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:41.210681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:41.210681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:41.210681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:41.212812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 476/936] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:41.221116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:41.395954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5329e3cd-21fc-4756-af78-36dd1fbddc64 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:41.465495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:41.466119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.466398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.466715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.467365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:41.467662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:41.469059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:41.485620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd52f7-0756-4458-9f4c-e310b4e3ed1a None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.486152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd52f7-0756-4458-9f4c-e310b4e3ed1a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.486152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bd52f7-0756-4458-9f4c-e310b4e3ed1a None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.488314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 477/937] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:41.494883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.495177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.495432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.498412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 461/938] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:41.505266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:41.548845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:41.550687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:41.563608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:41.624979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9535c1b6-014b-4eb2-9455-c056eb9559c5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:41.672794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:41.673798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.675428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.676380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.693914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:41.697109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:41.714714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:41.715728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:41.716730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:41.717298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 478/939] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:41.724566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 462/940] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:48:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:41.729877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:41.835585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf907b9-b568-41f8-8c0f-b0bfeb2e0ecf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:41.837964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:41.875573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:41.876213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.876488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.876758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.877534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:41.878327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:41.879745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f99c34-ad58-412c-ab29-97e478725f83 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:41.897759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 479/941] 10.222.0.72 () {56 vars in 1149 bytes} [Thu Aug 25 02:48:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:41.903072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:41.915974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355d5dd-4a93-4fbb-be4a-d3876313dd28 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.916312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355d5dd-4a93-4fbb-be4a-d3876313dd28 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.916564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355d5dd-4a93-4fbb-be4a-d3876313dd28 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.921669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 480/942] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:41.923051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:41.923336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:41.923610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:41.947520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:41.950689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:42.029538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 481/943] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:41 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:42.030298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.037975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c597b846-183c-4999-aa59-32af37a4241f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.040422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.075330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.075957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.076280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.076555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.088172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.089618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:42.105258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:42.106238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:42.107108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:42.107108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:42.107108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:42.111217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 463/944] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:42.112151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.155997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.170964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6119ce-69d2-46ec-94d7-6730070b3f78 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.220863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.222173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.222453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.222721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.223352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.224812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.227440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING keystone.server.flask.common [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 25 02:48:42.229939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53a43f63-1d2b-49bb-bad4-222bb62e14f0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.245766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.sql.core [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 02:48:42.245766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 02:48:42.245766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [parameters: {'id': '7ce97ae672d1464c944d982edf86ac12', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 02:48:42.245766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81633) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ce97ae672d1464c944d982edf86ac12.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ce97ae672d1464c944d982edf86ac12. Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:48:42.264824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 25 02:48:42.265945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application yield resource Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise self.value Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application session.commit() Aug 25 02:48:42.266874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.session.flush() Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application compat.raise_( Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 02:48:42.267765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 02:48:42.269802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application result.read() Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:48:42.270582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [parameters: {'id': '7ce97ae672d1464c944d982edf86ac12', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.271429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:42.273798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 7ce97ae672d1464c944d982edf86ac12. Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 482/945] 10.222.0.72 () {60 vars in 1140 bytes} [Thu Aug 25 02:48:42 2022] POST /identity/v3/projects => generated 262 bytes in 236 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:42.274889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.283403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.284225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.284509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.284784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.285441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:42.285746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.287231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.309354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 464/946] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:42.310294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.333173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.393697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd355e1-1db6-4124-87f9-56a39640d95e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.423524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c190d7c4-09de-4c84-bf0f-055d99a136da None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.429613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.430349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.430700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.431040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.438246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.440026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:42.453406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:42.454348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.455228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 483/947] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:42.456448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.465434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.466066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.466346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.466620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.467748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.474030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.475470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:42.490045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:42.490959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:42.491853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 465/948] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:42.492455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.562324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abced42a-eb08-4251-9fe7-1964b3c17118 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.569878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.593166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879ca5af-cb82-47d2-9b1b-afad39a8e99a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.595761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.596629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.597091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.597350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.597931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.599300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6a33fcc0-47bd-4500-b370-515b46bf6aca None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:42.607965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:42.609101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:42.609934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 484/949] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/services/object-store => generated 93 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:42.610905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf2da-7a61-49a3-8ecf-c1f88f34bd63 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.610905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf2da-7a61-49a3-8ecf-c1f88f34bd63 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.610905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdaf2da-7a61-49a3-8ecf-c1f88f34bd63 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.616692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 485/950] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:42.617437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf2da-7a61-49a3-8ecf-c1f88f34bd63 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.631824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.632719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.633000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.633271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.633928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:42.634227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.636474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.655111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 466/951] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:42.655911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.702480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.736639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdaf2da-7a61-49a3-8ecf-c1f88f34bd63 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.772509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d23bb18f-4950-4f8e-93f5-19af3b8eeb56 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.775761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.776490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.776766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.777035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.777796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:42.778104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.779560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092f03be-214c-4231-9de1-dbc83dd3678c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.792879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 486/952] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:42.793862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.794145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.794419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.814827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:42.816811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:42.820895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.821572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.821866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.822140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:42.822770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:42.824021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:42.825422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:42.827753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.836392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 467/953] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:42.837303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.897433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 487/954] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:42 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:42.898866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:42.954883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf761c7-7ae7-4c67-945a-127cd0817735 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:42.988397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:42.997183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:42.997858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:42.998139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:42.998414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/2305c248866447d6a85fe63385ee12a5/roles/4cec4b90840b45179679e5a71a51d668` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.000714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=2305c248866447d6a85fe63385ee12a5, role_id=4cec4b90840b45179679e5a71a51d668)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.002136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.024196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 468/955] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:48:42 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/2305c248866447d6a85fe63385ee12a5/roles/4cec4b90840b45179679e5a71a51d668 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:48:43.039477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2107e9b-d396-418b-8bf3-0ae05d9630e3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:43.079552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:43.080601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.081748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.082245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.083165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:43.083724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.085363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.091900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 488/956] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:42 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:43.097807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:43.170965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:43.185847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:43.219071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-606f3533-16e8-48b3-85f1-58889b98054e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:43.258906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:43.259621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.259851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.260067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.260745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.262103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.288565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 469/957] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:43 2022] POST /identity/v3/endpoints => generated 349 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:43.326552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497b9a96-abb1-40c0-8a60-166c4a03d198 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:43.361257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:43.380113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:43.380756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.381031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.381357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] PATH_INFO: `/v3/services/compute` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.382003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.383383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:43.394114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:43.395454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:43.396387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 489/958] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:43 2022] GET /identity/v3/services/compute => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:43.404235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:43.518035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f61c8f9-4eb5-4fb3-91a6-1cf6c1b7e01d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:43.535609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:43.554667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:43.555273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.555552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.555819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.556493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:43.556789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.558145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f20d374-72be-47fa-8e3c-db4c0d76eeb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.563239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 470/959] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:43 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:43.569433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:43.681345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec023c0-5fce-41db-86a3-1a5c4eefcafa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:43.717473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:43.718084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:43.718363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:43.718630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:43.719266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:43.719572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:43.721018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f1d2ac-2c00-441b-8aa6-b5583d3a32e6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:43.727162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 490/960] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:43 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:44.715060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c40a22-a051-49ea-a3a4-7897c98b7976 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:44.715569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c40a22-a051-49ea-a3a4-7897c98b7976 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:44.715673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c40a22-a051-49ea-a3a4-7897c98b7976 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:44.717350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 471/961] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:44.723744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74e9b1-b944-4237-a397-dc07cdc6a1cb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:44.724188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74e9b1-b944-4237-a397-dc07cdc6a1cb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:44.724382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74e9b1-b944-4237-a397-dc07cdc6a1cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:44.743139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5b74e9b1-b944-4237-a397-dc07cdc6a1cb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:44.744368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5b74e9b1-b944-4237-a397-dc07cdc6a1cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:44.795023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:44.821907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 491/962] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:44 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:45.087706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef75b7-4560-4ae8-9c4d-6b9e41302140 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.088259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef75b7-4560-4ae8-9c4d-6b9e41302140 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.088679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ef75b7-4560-4ae8-9c4d-6b9e41302140 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.090365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 472/963] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:45.095743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fcb1-86c8-4a67-b45f-2111d2d8347b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.096034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fcb1-86c8-4a67-b45f-2111d2d8347b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.096861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0604fcb1-86c8-4a67-b45f-2111d2d8347b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.106891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef75b7-4560-4ae8-9c4d-6b9e41302140 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.118742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0604fcb1-86c8-4a67-b45f-2111d2d8347b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:45.120071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0604fcb1-86c8-4a67-b45f-2111d2d8347b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:45.201135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 492/964] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:45.228904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ef75b7-4560-4ae8-9c4d-6b9e41302140 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.265094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:45.265948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.266227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.266500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.267143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:45.268818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:45.271355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING keystone.server.flask.common [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 25 02:48:45.285327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.sql.core [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 02:48:45.285327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 02:48:45.285327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [parameters: {'user_id': 'db365297d5d94f5d8a5c52ca64cfab68', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 02:48:45.285327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81632) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 25 02:48:45.286929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f3df-ca23-469b-a1a3-522f1f72df23 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.287412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f3df-ca23-469b-a1a3-522f1f72df23 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.287892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157f3df-ca23-469b-a1a3-522f1f72df23 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.289719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 493/965] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Aug 25 02:48:45.293512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:48:45.294374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application yield resource Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application next(self.gen) Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.rollback() Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.force_reraise() Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise self.value Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application session.commit() Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 25 02:48:45.295328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._prepare_impl() Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.session.flush() Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._flush(objects) Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application compat.raise_( Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application flush_context.execute() Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rec.execute(self) Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 25 02:48:45.296273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 25 02:48:45.297171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result = self._query(query) Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application conn.query(q) Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application result.read() Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 25 02:48:45.298047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [parameters: {'user_id': 'db365297d5d94f5d8a5c52ca64cfab68', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:45.299139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 25 02:48:45.300556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.301734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 473/966] 10.222.0.72 () {60 vars in 1131 bytes} [Thu Aug 25 02:48:45 2022] POST /identity/v3/users => generated 160 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:45.303485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.303878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.304371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.304830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.331133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:45.332678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:45.370229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:45.416413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 494/967] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:45.438840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e421e982-6172-4d15-8bd9-aeee75985918 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.474729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:45.475003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.475360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.475640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.475912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.485964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:45.488393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:45.504879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:45.505888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.506884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 474/968] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:45.512641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.519835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:45.586976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45785cb3-f602-4f87-96d6-4beb0be5883a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.623546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:45.624269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.624643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.625010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.635873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:45.641060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:45.642160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:45.644756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:45.646276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5b45ff-2ca9-4aa2-97ab-fb8bd12eeeb9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.652064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 495/969] 10.222.0.72 () {56 vars in 1120 bytes} [Thu Aug 25 02:48:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:45.652273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:45.652393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.688643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:45.689274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.689614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.689937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.690739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:45.691042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:45.692510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:45.742157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 475/970] 10.222.0.72 () {56 vars in 1101 bytes} [Thu Aug 25 02:48:45 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:45.742157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.767462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:45.772166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f20c19-c649-453e-a5eb-9163e227dd6d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.812789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:45.813409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.813692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.813962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.814657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:45.815696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:45.817396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a2956d-b1ba-44f0-aff3-e9fcb2b2e042 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:45.833492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 496/971] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:48:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:45.833492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53735-874d-4ab2-881c-972c359570da None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.833492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53735-874d-4ab2-881c-972c359570da None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.833492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf53735-874d-4ab2-881c-972c359570da None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.833492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 497/972] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:45.834462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53735-874d-4ab2-881c-972c359570da None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:45.867119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8242cee-7379-49ff-a22e-8a222e556ccc None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.910092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:45.910648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.910929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.911204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.911793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:45.913541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a599fa44-aa1b-40c8-8d1f-76918a90b6c3 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:45.922659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:45.923767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:45.924753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 476/973] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:45 2022] GET /identity/v3/services/object-store => generated 93 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:45.925552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:45.925620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:45.927251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:45.948383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:45.950070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:45.962060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf53735-874d-4ab2-881c-972c359570da None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:45.977517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.001648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.002279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.003082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.003346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.014322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.016008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:46.030814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:46.031941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:46.032836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:46.032836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:46.032836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:46.032836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 498/974] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:46.033068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.033719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 477/975] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:45 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:46.037701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.050485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.137187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47999b48-9d45-4d36-bb92-957970c9a728 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.144413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b5693e-dc11-4f5e-acd2-c073b8cf3918 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.174204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.174931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.175270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.175496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.176200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:46.176447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.177789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.178614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.179211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.179490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.179762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.180421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:46.180720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.182047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.183526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 499/976] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:46.189069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.202924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 478/977] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:46.203898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.220155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.274675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.297887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef7d2fc-d634-4ee6-b230-3bf7886145d5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.308639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f81ab5-a4b0-47a4-bc27-9dd118f65bea None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.333099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.333696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.333971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.334238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.334862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:46.335160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.336559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.341378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 500/978] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:46.341936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.345764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.346463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.346746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.347017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.355339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.356783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:46.367494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:46.368465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 479/979] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:46.369944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.443092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5892a366-ea49-425b-b555-9fc9cff33f91 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.443723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.468784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91153000-bd0f-4903-a72d-4eb8f80d71db None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.477515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.478124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.478401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.478676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.479314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.480705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.500446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 501/980] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:46 2022] POST /identity/v3/services => generated 242 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:46.501439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.504929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.513421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.514134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.514341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.514704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.515381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] RBAC: Adding query filter params (interface=admin, service_id=cc8d1ff154d64dab8a697b60d5c247f6, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:46.515961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.517489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.524645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 480/981] 10.222.0.72 () {56 vars in 1249 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/endpoints?service_id=cc8d1ff154d64dab8a697b60d5c247f6&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:46.530536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.626361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34bff0dd-b588-4fd1-b32a-7f8ec0885a91 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.653575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868f1cb-13ab-4394-9a90-d621a5305fd2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.672368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.672981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.673266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.673545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.674886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:46.675378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.677120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.697646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 502/982] 10.222.0.72 () {56 vars in 1149 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:46.697816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.698434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.698788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.699065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.699676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.701067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.702553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.703204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:46.709652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 481/983] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/services => generated 1727 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:48:46.772882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:46.820536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84c5fbf-a303-43a5-b28b-08878235cf5b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:46.859592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:46.860837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:46.860837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:46.860837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:46.930003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:46.931449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:46.994652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:47.042365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 503/984] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:46 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:48:47.048103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:47.153847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff6a64f-d4b5-4101-adb7-9f09a210d269 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:47.189538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:47.190222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.190545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.190871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.201619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:47.203045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:47.217888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:47.218856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:47.219762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:47.219762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:47.219762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:47.219762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 482/985] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:47.226655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:47.326966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96d2c0d-3601-4f92-bda1-991e5b395c31 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:47.361727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:47.362339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.362693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.362971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.363619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:47.363922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:47.365317 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:47.382191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 504/986] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:47.383396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:47.433838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:47.485583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5e4c64-7046-49e4-9e41-8c0b11b2aa42 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:47.520582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:47.521234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.521514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.521785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.528492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:47.529923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:47.540960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:47.541819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:47.542700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 483/987] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:47.548973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:47.572107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:47.653906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffd1f36-7b3c-4732-9521-845c54fba4c1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:47.687627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:47.688266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.688545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.688815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.689508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:47.690430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:47.691895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d29d3b1-5e0b-4d10-b31e-cdce056fafbf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:47.708902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 505/988] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:47.710175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:47.811539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e66b6b6-071b-4966-bf63-42547bade8f5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:47.822793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:47.846877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:47.847470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:47.847755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:47.848028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:47.848768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] RBAC: Adding query filter params (role.id=4cec4b90840b45179679e5a71a51d668, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=2305c248866447d6a85fe63385ee12a5) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:47.849079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:47.850494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b9b015-f390-4ff0-9d6e-41d54661ca48 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:47.860406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 484/989] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:47 2022] GET /identity/v3/role_assignments?user.id=2305c248866447d6a85fe63385ee12a5&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=4cec4b90840b45179679e5a71a51d668 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:48.454398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c7d1-5055-45fc-b4d7-e4756f0b495c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:48.454945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c7d1-5055-45fc-b4d7-e4756f0b495c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:48.454945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c07c7d1-5055-45fc-b4d7-e4756f0b495c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:48.457073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 506/990] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:48.462219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81a18-94db-42b2-954c-0dc0fb5831b8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:48.462615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81a18-94db-42b2-954c-0dc0fb5831b8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:48.462787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de81a18-94db-42b2-954c-0dc0fb5831b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:48.481490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1de81a18-94db-42b2-954c-0dc0fb5831b8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:48.482675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1de81a18-94db-42b2-954c-0dc0fb5831b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:48.552355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 485/991] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:48.643932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415230-1503-4e07-b0be-37943f657551 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:48.644287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415230-1503-4e07-b0be-37943f657551 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:48.644521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9415230-1503-4e07-b0be-37943f657551 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:48.645998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 507/992] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:48.651355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:48.651641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:48.651915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:48.669954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:48.671108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:48.738364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 486/993] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:48 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:48.821681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415230-1503-4e07-b0be-37943f657551 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:48.904613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:48.927659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9415230-1503-4e07-b0be-37943f657551 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:48.969014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:48.969657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:48.969937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:48.970212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] PATH_INFO: `/v3/services/compute` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:48.970803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:48.973153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:48.982599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:48.983542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:48.984991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 508/994] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:48 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:48.993418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.012965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.032467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:49.104590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7125b73-532f-4725-aba5-e4bf69529d98 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.122769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce665f47-071b-4e7b-ba6b-668b40d0ef2f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.142463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.143171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.143452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.143726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.144384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:49.144688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.146080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.155350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 487/995] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:48 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:49.156353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.159581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.160593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.160593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.160791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.161333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.162680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:49.171447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:49.172617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:49.173443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 509/996] 10.222.0.72 () {56 vars in 1126 bytes} [Thu Aug 25 02:48:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:49.179400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.191700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:49.263751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:49.268910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faac0b2d-bd8e-4ed4-97d0-ea92c0a58854 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.293835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d640b6-4b15-4083-92a1-539aa478bb9c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.305169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.305768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.306046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.306316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.306932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:49.307231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.308617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.313660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 488/997] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:49 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:49.319842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.332328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.332965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.333248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.333522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.334156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:49.334458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.335825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.345395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 510/998] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:49.347106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.428875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:49.434435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24abeab2-8eb3-4289-935b-dd335f188721 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.461750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ffd2b7-db75-40e1-a9cc-c968bb7e9d6b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.472298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.472899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.473386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.473505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.474128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] RBAC: Adding query filter params (interface=public, service_id=48b2ecd27a11421d8759974e57d2701c, region_id=RegionOne) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:49.474419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.475771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.486032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 489/999] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:49 2022] GET /identity/v3/endpoints?service_id=48b2ecd27a11421d8759974e57d2701c&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:49.488077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.498410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.499018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.499297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.499571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.500243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:49.500546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.501906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.506806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 511/1000] 10.222.0.72 () {56 vars in 1122 bytes} [Thu Aug 25 02:48:49 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:49.512291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:49.524463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:49.603539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ecf461-c13d-4282-8a2d-23f6dd928592 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.619952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e1b10-9ddb-4c6f-a160-ed40fb3621f9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:49.641202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deade16a-2460-4281-8e75-4307f012bb92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.642021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deade16a-2460-4281-8e75-4307f012bb92 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.642451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deade16a-2460-4281-8e75-4307f012bb92 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.643487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deade16a-2460-4281-8e75-4307f012bb92 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.644135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deade16a-2460-4281-8e75-4307f012bb92 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.645550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deade16a-2460-4281-8e75-4307f012bb92 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.652165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 490/1001] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:49 2022] GET /identity/v3/services => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 02:48:49.661920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e498e4-f46a-482a-92df-83775953e697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:49.662559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e498e4-f46a-482a-92df-83775953e697 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.662837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e498e4-f46a-482a-92df-83775953e697 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.663110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e498e4-f46a-482a-92df-83775953e697 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.663794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e498e4-f46a-482a-92df-83775953e697 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:49.665262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e498e4-f46a-482a-92df-83775953e697 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:49.672199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:49.692628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 512/1002] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:49 2022] POST /identity/v3/endpoints => generated 325 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:48:49.816386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d446-45e9-42d1-beb0-205f7fdd2ca0 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.816565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d446-45e9-42d1-beb0-205f7fdd2ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.816835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d98d446-45e9-42d1-beb0-205f7fdd2ca0 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.818211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 491/1003] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:49.824216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:49.824499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:49.824778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:49.844273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:49.845477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:49.923011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 513/1004] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:49 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:50.196338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d446-45e9-42d1-beb0-205f7fdd2ca0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:50.293507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:50.305990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d98d446-45e9-42d1-beb0-205f7fdd2ca0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:50.341391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:50.342013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:50.342292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:50.342563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:50.343137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:50.344652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:50.354053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:50.355022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:50.355855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:50.360115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 492/1005] 10.222.0.72 () {56 vars in 1105 bytes} [Thu Aug 25 02:48:50 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:50.361359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:50.461909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ee41c8-17eb-48bb-9798-356956be3538 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:50.484887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:50.497796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:50.498397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:50.498669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:50.498936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:50.499559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:50.499853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:50.501230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98899200-11a5-4631-a5dc-6d43c830d4ad None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:50.510517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 514/1006] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:50.511714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:50.618949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62a8a4b-79a0-4e41-b750-216202eba706 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:50.652982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:50.653604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:50.653865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:50.654141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:50.654774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:50.655078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:50.656468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8361087-af05-4d9b-b421-7913249b81c3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:50.668303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 493/1007] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:50 2022] GET /identity/v3/services?type=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:51.616798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c41a-bb2e-4891-9803-b4b140e108ab None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:51.617314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c41a-bb2e-4891-9803-b4b140e108ab None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:51.617314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9569c41a-bb2e-4891-9803-b4b140e108ab None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:51.618819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 515/1008] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:51.623868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:51.624269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:51.624444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:51.641623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b879c-317a-460e-84ce-189732547bf6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:51.641938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b879c-317a-460e-84ce-189732547bf6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:51.642177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b879c-317a-460e-84ce-189732547bf6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:51.643496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:51.643947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 516/1009] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:51.644723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:51.649345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:51.649622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:51.649888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:51.659220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:51.668327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:51.669509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:51.720318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 494/1010] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:51.743721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 517/1011] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:51 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:51.992968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:52.012441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:52.097975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8bd648f-4bfd-4188-b67f-847e53d69a5a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:52.119534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5371b706-2c66-4a3c-b168-88bd99baf473 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:52.133520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:52.134152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.134427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.134695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.135269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:52.136638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:52.137103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:52.146796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:52.147807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:52.148709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 495/1012] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:52.154629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:52.164222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:52.164849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.165120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.165387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.166476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:52.167901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:52.172080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 518/1013] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:52.172219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:52.175310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:52.265083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350167ed-bae4-42d4-a389-3c73b71545b7 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:52.285621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518bebbe-8b2e-40af-bc38-b83cb9bcafd3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:52.303044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:52.304014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.304323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.304596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.305221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:52.305519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:52.307416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:52.319353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 496/1014] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:52 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:52.320494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:52.321384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:52.322005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.322345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.322618 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.323525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:52.325251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:52.367660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 519/1015] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:52 2022] POST /identity/v3/projects => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:48:52.411913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:52.440318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719eed4e-a003-4553-94b8-0c8068d5b3e3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:52.477356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:52.477976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.478315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.478585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.479273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] RBAC: Adding query filter params (type=compute) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:52.479576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:52.480986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faada64f-1a96-4fc8-8323-ae6d0f0bd5fa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:52.492177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 497/1016] 10.222.0.72 () {56 vars in 1112 bytes} [Thu Aug 25 02:48:52 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:52.493926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:52.532642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:52.576664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d27b9-0cb5-4db3-8462-f7e7095703f7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.576976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d27b9-0cb5-4db3-8462-f7e7095703f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.577219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456d27b9-0cb5-4db3-8462-f7e7095703f7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.578561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 498/1017] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:52.583874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d4566-ebb7-4b9b-8e3c-edaabc6451af None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.584189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d4566-ebb7-4b9b-8e3c-edaabc6451af None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.584458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0d4566-ebb7-4b9b-8e3c-edaabc6451af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.604319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc4e569-09f9-4c22-805e-9bb28c9756d7 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:52.608388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8b0d4566-ebb7-4b9b-8e3c-edaabc6451af None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:52.609653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8b0d4566-ebb7-4b9b-8e3c-edaabc6451af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:52.642066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:52.642738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:52.643564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:52.643853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:52.644628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:52.646049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:52.668109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 520/1018] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:52 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:48:52.698686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 499/1019] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:52 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:52.970460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:53.066038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:53.076916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92958d6f-0d6d-4d34-ace8-03e696f42844 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:53.109955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474f3029-1071-4a67-9583-de6fac299c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:53.110557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f3029-1071-4a67-9583-de6fac299c87 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:53.110832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f3029-1071-4a67-9583-de6fac299c87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:53.111099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474f3029-1071-4a67-9583-de6fac299c87 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:53.112296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f3029-1071-4a67-9583-de6fac299c87 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:53.113649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-474f3029-1071-4a67-9583-de6fac299c87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:53.132151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 521/1020] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:48:52 2022] POST /identity/v3/services => generated 242 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:54.331373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01df6d3-39a1-4057-90f6-ea80d8071202 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:54.331866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01df6d3-39a1-4057-90f6-ea80d8071202 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:54.331866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01df6d3-39a1-4057-90f6-ea80d8071202 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:54.333261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 500/1021] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:54.338446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c198f0-6dc8-4021-90cd-0d6314942094 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:54.338843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c198f0-6dc8-4021-90cd-0d6314942094 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:54.339007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c198f0-6dc8-4021-90cd-0d6314942094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:54.358636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f0c198f0-6dc8-4021-90cd-0d6314942094 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:54.359825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f0c198f0-6dc8-4021-90cd-0d6314942094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:54.433412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 522/1022] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:54.669893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68d2c-318e-49d6-8449-657b3193ce3a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:54.670147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68d2c-318e-49d6-8449-657b3193ce3a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:54.670416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae68d2c-318e-49d6-8449-657b3193ce3a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:54.671841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 501/1023] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:54.677531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:54.677816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:54.678089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:54.696502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:54.697681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:54.702939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68d2c-318e-49d6-8449-657b3193ce3a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:54.769502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:54.770993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 523/1024] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:54 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:48:54.806541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae68d2c-318e-49d6-8449-657b3193ce3a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:54.840843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:54.841463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:54.841740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:54.842011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:54.843105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:54.844559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:54.846639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 502/1025] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:54.852229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:54.862855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:54.963989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caab902c-a7d0-4e6d-bed2-44a9f1a9f078 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:54.998825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc12b3-47fe-444f-9d8b-64e29fc23779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:54.999429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc12b3-47fe-444f-9d8b-64e29fc23779 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:54.999706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc12b3-47fe-444f-9d8b-64e29fc23779 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:54.999977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc12b3-47fe-444f-9d8b-64e29fc23779 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.000657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc12b3-47fe-444f-9d8b-64e29fc23779 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.002610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc12b3-47fe-444f-9d8b-64e29fc23779 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.036075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 524/1026] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:48:54 2022] POST /identity/v3/users => generated 285 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:48:55.045956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.059367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81437a-ee3d-4a74-99dd-57657136dd7d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.059656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81437a-ee3d-4a74-99dd-57657136dd7d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.059933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81437a-ee3d-4a74-99dd-57657136dd7d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.061345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 525/1027] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:55.068060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.068475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.068631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.093064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:55.095241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:55.163615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5743933-a665-429b-89be-e737f5fcbf0e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.165768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:55.179450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 526/1028] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:55 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:55.202932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.203488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.203767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.204056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.206018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:55.217432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:55.222308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:55.223288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:55.224169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 503/1029] 10.222.0.72 () {56 vars in 1120 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:55.229430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.336740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb09be-296a-4068-a42b-9302144c1fbf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.375303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.375978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.376333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.376493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.377357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:55.377770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.379151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.387801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 527/1030] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:55.394402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.449038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.503150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c1a265-e888-487c-8b4b-0a08a3deac93 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.507290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:55.539303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.539923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.540236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.540506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.551392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.552865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.555540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653a3ec9-451c-4e0d-bb53-57d473589498 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:55.567558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:55.568597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:55.569491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:55.569491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:55.569491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:55.569491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 504/1031] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:55.574545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.595172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.596381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.596693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.596929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] PATH_INFO: `/v3/services/image` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.597623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.598986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:55.608447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:55.609412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:55.610246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 528/1032] 10.222.0.72 () {56 vars in 1105 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/services/image => generated 86 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:55.616213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.626604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:55.685550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8edaa96a-1f95-41ba-8a64-0c2f96ade798 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.721813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.722647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.722930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.723199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.723834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:55.724162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.725523 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.730386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71876e4a-ddbe-4ef3-bc61-061c67de5e2d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.737648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 505/1033] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:55.743541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.753624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:55.770628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.771240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.771517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.771787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.772562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:55.773069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.774434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.784631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 529/1034] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/services?name=image => generated 122 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:55.785601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.853941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61c5d144-318c-4457-8869-a5136507b935 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.861046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:55.888313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d9a73-8256-47ac-880c-da609ac05c88 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:55.891349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.891980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.892289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.892592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.900023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.901478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:48:55.912734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:55.913885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:55.914833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 506/1035] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:48:55.919502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:55.932711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:55.936857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:55.936857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:55.936857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:55.936857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] RBAC: Adding query filter params (type=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:55.936857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:55.938059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:55.949266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 530/1036] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:55.953649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:56.008121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:56.040124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a355dc8-4960-4961-be2e-799227211db6 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.059296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19296aa6-0bd6-4329-a79d-d3d128ef2bee None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.078722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.079734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.080336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.080766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.081774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:56.082246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.083865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.092887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.093492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.093769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.094038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.094733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] RBAC: Adding query filter params (interface=public, service_id=04166070b53143208189c5e21d8d387c, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:56.095034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.096755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.101936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 531/1037] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/endpoints?service_id=04166070b53143208189c5e21d8d387c&interface=public®ion_id=RegionOne => generated 194 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:56.103424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 507/1038] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:48:55 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:56.108904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:56.109050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:56.135588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:56.213290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a941a625-2448-472b-a8be-d227320f4f9a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.214850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11016b64-43c8-4de2-bbd2-51f08a970514 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.230412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:56.251758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.252906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.253179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.253446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.254043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.254918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.255496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.255594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.255802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.256107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.262308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 532/1039] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:48:56 2022] GET /identity/v3/services => generated 1957 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:48:56.332662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.334196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.362183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:56.445323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 508/1040] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:56 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:56.451193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:56.553183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dc04f4-51bb-4d80-b919-4aeefca7cb11 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.587950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.588602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.588879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.589148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.599640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.601094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:48:56.616190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:56.617196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:48:56.618200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:48:56.618200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:48:56.618200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:56.618200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 533/1041] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:56.628008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:56.730639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0db64-2cec-4dbf-b1a6-1b354df27296 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.754644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:56.766838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.768060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.768421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.768766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.769471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:56.769844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.771299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.787862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 509/1042] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:48:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:56.789211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:56.819620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:56.895637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a75763f7-78ce-4340-ab56-5c44b955b25a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:56.930224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:56.930998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:56.931382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:56.931776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:56.941934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:56.943369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-5a7f41d9-4a78-4f03-93ea-77433d07ac1c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:48:56.957370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:56.958294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:48:56.959164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:56.960340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 534/1043] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:48:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:56.964437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:57.066499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6374531d-4ebd-48e3-afc5-56cfbf700a16 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:57.068676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0dd9-0691-4d51-8365-4f06587388b1 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.068962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0dd9-0691-4d51-8365-4f06587388b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.069239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fc0dd9-0691-4d51-8365-4f06587388b1 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.070639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 535/1044] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:48:57.075611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.075891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.076193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.094513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:57.095868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:57.103091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:57.103693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.103970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.104279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.104964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:57.105270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:57.106675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:57.119635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 510/1045] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:48:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:57.125522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:57.171425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 536/1046] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:57 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:57.178082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:57.236182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28836358-a190-46b7-a1df-1fde0bc3c6b5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:57.270803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:57.271397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.271671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.271937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.272677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] RBAC: Adding query filter params (role.id=4cec4b90840b45179679e5a71a51d668, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=a4e5a17f91134c59bec66f04a175ef05) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:57.272981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:57.274389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:57.288324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 511/1047] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:57 2022] GET /identity/v3/role_assignments?user.id=a4e5a17f91134c59bec66f04a175ef05&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=4cec4b90840b45179679e5a71a51d668 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:57.450330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:57.469623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:57.552891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1921b5bf-21ef-40a5-aa36-e767e954a534 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:57.586907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:57.587540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.587816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.588105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.599090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:57.603886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:57.604916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:48:57.605787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:57.608120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 537/1048] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:48:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:57.611084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:57.713750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad1bb04-a781-4c16-b43a-2c11326029a4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:57.723386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:57.749325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:57.749929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.750206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.750479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.751139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:57.751439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:57.753415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:57.769410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 512/1049] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:48:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:57.769620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:57.849787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:57.872334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0199fd05-a6cf-40dc-9669-99a59c830e20 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:57.907176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ae47e1-ab42-4327-8e7a-f16d4cb7a9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:57.907802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae47e1-ab42-4327-8e7a-f16d4cb7a9d3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:57.908221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae47e1-ab42-4327-8e7a-f16d4cb7a9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:57.908683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ae47e1-ab42-4327-8e7a-f16d4cb7a9d3 None admin] PATH_INFO: `/v3/users/081d7de94fca4abb99504369fb81f5f3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:57.921920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae47e1-ab42-4327-8e7a-f16d4cb7a9d3 None admin] RBAC: Authorizing `identity:get_user(user_id=081d7de94fca4abb99504369fb81f5f3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:57.923338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ae47e1-ab42-4327-8e7a-f16d4cb7a9d3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:57.929842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 538/1050] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:48:57 2022] GET /identity/v3/users/081d7de94fca4abb99504369fb81f5f3 => generated 285 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:57.931165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:58.038387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c65c1-ede2-4010-b811-d5c379fd3c5f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:58.073004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:58.073604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.073883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.074154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.114049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:58.144819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:58.146271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:58.219126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4055b-3e3a-47be-adba-9591ac807531 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.219413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4055b-3e3a-47be-adba-9591ac807531 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.219768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4055b-3e3a-47be-adba-9591ac807531 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.221235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 539/1051] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:58.226861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.227139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.227412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.246196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:58.247378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:58.250908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 513/1052] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:48:57 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:48:58.257526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:58.324744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 540/1053] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:58 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:58.334781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:58.368649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9ce373-43de-46cf-8920-435d1ae48719 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:58.403165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:58.403783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.404078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.404354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.405462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] RBAC: Authorizing `identity:get_project(project_id=199c72673bf441979fb2d0fba03d0844)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:58.406882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:58.409531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 514/1054] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:48:58 2022] GET /identity/v3/projects/199c72673bf441979fb2d0fba03d0844 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:58.415470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:58.482423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:58.519472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e902f57-ad82-4295-921c-a3b8c45e0254 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:58.553905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:58.554504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.554784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.555056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.555795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=199c72673bf441979fb2d0fba03d0844, user.id=081d7de94fca4abb99504369fb81f5f3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:58.556132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:58.557562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:58.568305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 541/1055] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:48:58 2022] GET /identity/v3/role_assignments?user.id=081d7de94fca4abb99504369fb81f5f3&scope.project.id=199c72673bf441979fb2d0fba03d0844&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:48:58.607295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:58.722093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef7f165-0ef7-4296-9a3a-81c8159a7357 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:58.756775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:58.757408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.757687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.757960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] PATH_INFO: `/v3/services/image` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.758537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:58.759891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:58.768880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:58.769854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:48:58.771287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 515/1056] 10.222.0.72 () {56 vars in 1105 bytes} [Thu Aug 25 02:48:58 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:58.778349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:58.882555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcb4d81-440d-4f32-811a-d6c42e2a0e10 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:58.912390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:58.919410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:58.920016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:58.920354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:58.920593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:58.921220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] RBAC: Adding query filter params (name=image) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:58.921520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:58.922874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:58.933053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 542/1057] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:58 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:58.934295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:58.938048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:59.043725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a86d50-baac-4447-b00b-847c7440437a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:59.078894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:59.079502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.079781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.080595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.081403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] RBAC: Adding query filter params (type=image) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:59.081703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:59.083062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfce6ad3-9495-4b0a-9c25-cf801f63e6bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:59.092721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 516/1058] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:58 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:59.093944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:59.196252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef6e7-4815-43bf-a41b-339eab3d9ab1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.196434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef6e7-4815-43bf-a41b-339eab3d9ab1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.196700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850ef6e7-4815-43bf-a41b-339eab3d9ab1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.197716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ad9e35-6ccc-49f9-8d74-9da39fb14ed9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:59.198179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 517/1059] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:48:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:48:59.204032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.204345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.204622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.223967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:48:59.225184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:48:59.234101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:59.234707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.234989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.235260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.235931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:59.237998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:59.258342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 543/1060] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:48:59 2022] POST /identity/v3/endpoints => generated 327 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:48:59.300503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:59.317454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 518/1061] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:48:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:48:59.591610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:59.644747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:48:59.701075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a30ad816-e1af-4001-aeed-192f21336703 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:59.736914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:59.737541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.737815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.738081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.748636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:48:59.753959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:48:59.754890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:48:59.755727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 544/1062] 10.222.0.72 () {56 vars in 1120 bytes} [Thu Aug 25 02:48:59 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:48:59.760966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:48:59.858850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258b87b1-3a3f-400a-8caf-da4e093cb24c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:48:59.893733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:48:59.894341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:48:59.894613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:48:59.894877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:48:59.895539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:48:59.895837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:48:59.897209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:48:59.910664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 519/1063] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:48:59 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:48:59.912266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.023634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057fc562-38fd-40ea-a763-56ccbe87bfe4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:00.034329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:00.059805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:00.060719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.061266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.061678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.073640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:00.075266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:49:00.089723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:00.090840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:49:00.091905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:49:00.091905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:00.091905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:00.098876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 545/1064] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:48:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:00.099887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.157735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:00.204642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1c64e2-d597-41fc-be8d-d8a939a2c4da None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:00.239028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:00.239639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.239923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.240233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.240877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:00.241181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:00.242545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:00.255403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 520/1065] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:00.261328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.367264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a803927e-32f7-4cf6-b464-363d13bca942 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:00.401610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:00.402233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.402505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.402768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.411024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:00.412482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-1d8d48f1-e6f1-4962-94d8-a962301c92a2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:49:00.423370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:00.424362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:49:00.425284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:00.428374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 546/1066] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:00.430352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.491073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c3e7d-9865-432a-86af-9e4a8c32ddf6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.491376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c3e7d-9865-432a-86af-9e4a8c32ddf6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.491622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810c3e7d-9865-432a-86af-9e4a8c32ddf6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.493128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 547/1067] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:49:00.497898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.498173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.498454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.517043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:00.518787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:00.536248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:00.536689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812aa1f4-f743-4175-b71b-ae36e2295903 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:00.553469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:00.576793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:00.577400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.577680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.577959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.578689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:00.578997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:00.580943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:00.589379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 548/1068] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:49:00.605857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 521/1069] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:00.607372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.710422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5333ff-e234-41a2-a8d6-c21802eeb88f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:00.744820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:00.745447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.745726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.745996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.756738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:00.758242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:49:00.773401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:00.774338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:49:00.780010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:49:00.780010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:00.780010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:00.780010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 549/1070] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:00.781977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.869435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.873203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:00.887625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b30032-863c-4fdd-a5d2-a5fbc03a1aea None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:00.927317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:00.927927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:00.928241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:00.929031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:00.929738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:00.930310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:00.932426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:00.945140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 522/1071] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:00.950490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:00.985972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:00.988649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4db958-5bc2-4ca5-9232-d73e8c9c5132 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.025463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.026086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.026365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.026634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.038164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:01.042842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:01.043794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:01.044664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 550/1072] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:01.050667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.066075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d3a873-c7c6-4999-8616-831999b2f0f9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.101367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.102303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.102725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.103234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.112169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.114389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.120350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:49:01.128249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:01.129171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:01.130098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 523/1073] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:49:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:01.135227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.166149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d69aa199-ab35-43ee-94e0-f3cb348f1cf9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.200919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.201522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.201803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.202078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.202743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:01.203047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.204450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec28ebf-f6d0-4830-a128-25ede2290808 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.213891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 551/1074] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:01.215104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f7d3-992e-4f4f-b186-839702b9577d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.215388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f7d3-992e-4f4f-b186-839702b9577d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.215712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab26f7d3-992e-4f4f-b186-839702b9577d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.216955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 552/1075] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:01.219486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f7d3-992e-4f4f-b186-839702b9577d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.237593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:01.246550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4986af3e-f975-4557-b09e-6a5864e5c5d0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.279828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.280460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.280741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.281011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.281695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:01.282000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.283531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84555c96-d97d-4786-a61e-4792df730c86 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.295201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 524/1076] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:49:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:01.295201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.295201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.295201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.314956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:01.316170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:01.328685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab26f7d3-992e-4f4f-b186-839702b9577d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.355033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:01.364200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.364826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.365108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.365380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] PATH_INFO: `/v3/users/081d7de94fca4abb99504369fb81f5f3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.366506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] RBAC: Authorizing `identity:get_user(user_id=081d7de94fca4abb99504369fb81f5f3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.367935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.369542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 553/1077] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:01 2022] GET /identity/v3/users/081d7de94fca4abb99504369fb81f5f3 => generated 285 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:01.370270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.385158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 525/1078] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:01.386004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.471324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:01.487949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f28cc09-6f37-4d44-a91d-15dd6410dfb9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.490872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4586d31b-9d23-459a-8c4f-539a76e609a1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.526688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.526903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.527313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.527485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.527596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.527757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.527862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.528010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/a4e5a17f91134c59bec66f04a175ef05/roles/4cec4b90840b45179679e5a71a51d668` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.528959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] RBAC: Authorizing `identity:get_project(project_id=199c72673bf441979fb2d0fba03d0844)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.530264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=a4e5a17f91134c59bec66f04a175ef05, role_id=4cec4b90840b45179679e5a71a51d668)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.530363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.531676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.532248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 526/1079] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:01 2022] GET /identity/v3/projects/199c72673bf441979fb2d0fba03d0844 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:01.538293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.546141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 554/1080] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:49:01 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/a4e5a17f91134c59bec66f04a175ef05/roles/4cec4b90840b45179679e5a71a51d668 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:49:01.653409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c21b77-2aa7-4948-9ca0-1fe34e0dcd05 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.654414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:01.697662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.698329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.698602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.698877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844/users/081d7de94fca4abb99504369fb81f5f3/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.702167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] RBAC: Authorizing `identity:create_grant(project_id=199c72673bf441979fb2d0fba03d0844, user_id=081d7de94fca4abb99504369fb81f5f3, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.703917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.717118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:01.718752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 527/1081] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:49:01 2022] PUT /identity/v3/projects/199c72673bf441979fb2d0fba03d0844/users/081d7de94fca4abb99504369fb81f5f3/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 02:49:01.772374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a629e6cd-a0b2-476c-86d3-78b4d65c2417 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:01.810370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:01.810982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:01.811261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:01.811533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:01.888011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:01.889500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:01.955893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:02.008074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 555/1082] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:49:02.012337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:02.027280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:02.120207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac49c04-fc2e-4af4-aff2-d35899099fff None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:02.154000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:02.154633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:02.154913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:02.155185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:02.166600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:02.168202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-92eb2771-db0e-49c4-a4dd-1a5d207320ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:49:02.182742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:02.183762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:49:02.184697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:49:02.184697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:02.184697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:02.188458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 528/1083] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:02.189899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:02.292583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b474d-75c8-45a1-b950-0113d8370215 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:02.326668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:02.327439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:02.327823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:02.328201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:02.328975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:02.329367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:02.330953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8a704d-927a-407d-ad62-4d728c341f39 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:02.348084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 556/1084] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:49:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:03.465880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1a9d6-8ca3-4bde-8d26-845a503e0134 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.466417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1a9d6-8ca3-4bde-8d26-845a503e0134 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.466417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1a9d6-8ca3-4bde-8d26-845a503e0134 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.467757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 529/1085] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:03.473138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4ac3-c03a-49b9-9580-8af660b89cac None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.473558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4ac3-c03a-49b9-9580-8af660b89cac None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.473803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ce4ac3-c03a-49b9-9580-8af660b89cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.491968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b5ce4ac3-c03a-49b9-9580-8af660b89cac None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:03.493166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b5ce4ac3-c03a-49b9-9580-8af660b89cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:03.502825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:03.558768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 557/1086] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:03.622682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa49d38-5fb5-47ad-976a-0e4eccfcd926 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.622965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa49d38-5fb5-47ad-976a-0e4eccfcd926 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.623237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa49d38-5fb5-47ad-976a-0e4eccfcd926 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.624597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 530/1087] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:03.630511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.630799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.631071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.648969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:03.650141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:03.715169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 558/1088] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:03.824356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa49d38-5fb5-47ad-976a-0e4eccfcd926 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:03.886417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:03.927260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa49d38-5fb5-47ad-976a-0e4eccfcd926 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:03.964303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:03.964925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:03.965203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:03.965471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:03.975311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:03.979941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:03.980895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:03.981744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 531/1089] 10.222.0.72 () {56 vars in 1120 bytes} [Thu Aug 25 02:49:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:03.982433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:03.986968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.057667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.083536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55f761b-d7ef-4f96-bd2a-700bcce4bbdc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.088576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52587200-71b0-4b87-8ea3-5b28d167a513 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.110570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.119655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.120314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.120587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.120855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.123210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.123812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.124146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.124426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.125086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:04.125384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.126739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.131059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:04.134508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 532/1090] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:49:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:04.135681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:04.136801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:04.137827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:04.140352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 559/1091] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:04.140501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.143122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.238748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3dbac2d-dc49-47a7-9059-5188a701d408 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.241545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8fe4b7-b650-41f3-af22-b84a63f2afaf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.273928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.274540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.274817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.275085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.275313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.275905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.276223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.276497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.277159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:04.277463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.278826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.280192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.285976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.287400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.287875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 560/1092] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:04.293570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:49:04.302032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:04.303042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:49:04.303924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:49:04.303924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:04.303924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:04.303924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 533/1093] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:04.308752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.343898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.399325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca391d3e-9f32-4bdf-a2ef-db8f5c320834 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.409554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9575ea-a4d0-4407-b63d-792d4d65165e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.431898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.432546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.432819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.433085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] PATH_INFO: `/v3/users/081d7de94fca4abb99504369fb81f5f3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.434208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] RBAC: Authorizing `identity:get_user(user_id=081d7de94fca4abb99504369fb81f5f3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.435621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.437221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 561/1094] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/users/081d7de94fca4abb99504369fb81f5f3 => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:04.441989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.442663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.443009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.443112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.443281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.443912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:04.444246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.445585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.457900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 534/1095] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:04.463253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.506685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.544805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebc18cb-1015-4b6b-9dee-79eeba5eedf0 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.553987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.560356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4ae344-6a58-4608-bf24-08d62dd5c6bd None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.578710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.579312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.579612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.580428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.595046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.595642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.595921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.596228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.603105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.604568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:49:04.615809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:04.616956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:04.617957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 535/1096] 10.222.0.72 () {56 vars in 1093 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:49:04.623097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.649313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.650755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.716850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.729126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1603d8-4f90-418d-9d67-c5d2ebeb9834 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.753273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 562/1097] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:49:04.758964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.763367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.763966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.764292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.764562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.765533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:04.765830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.767245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.784750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 536/1098] 10.222.0.72 () {56 vars in 1133 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:04.790422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.805580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.857292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f3ae1a-b4cc-43ff-9f60-14e52d792b0a None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.888293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d522af-160c-4217-a31e-f2b5c304fc45 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:04.892999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.893623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.893904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.894180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.895292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] RBAC: Authorizing `identity:get_project(project_id=199c72673bf441979fb2d0fba03d0844)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.896745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:04.898369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 563/1099] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/projects/199c72673bf441979fb2d0fba03d0844 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:04.904342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:04.922824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:04.924032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:04.924347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:04.924611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:04.934999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:04.995999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:04.997466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.005520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276353dd-8efc-4685-8dfa-1a6f7df45e2f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:05.012415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:05.042476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:05.043105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:05.043388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:05.043666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:05.044491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=199c72673bf441979fb2d0fba03d0844, user.id=081d7de94fca4abb99504369fb81f5f3) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:05.044808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:05.046236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.052933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 564/1100] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/role_assignments?user.id=081d7de94fca4abb99504369fb81f5f3&scope.project.id=199c72673bf441979fb2d0fba03d0844&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:05.102529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 537/1101] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:04 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 25 02:49:05.108561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:05.208464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:05.214760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2cd5ac-43ca-43af-ba16-a52960d1fae3 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:05.249526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:05.250151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:05.250428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:05.250693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:05.261945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:05.263365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:49:05.277262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:05.278220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:49:05.279106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:49:05.279106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:49:05.279106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:05.279106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 565/1102] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:05.284699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:05.384204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176074a9-9119-4ea6-af03-d24471263baf None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:05.398437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:05.418996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:05.419597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:05.419877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:05.420191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:05.420828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:05.421130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:05.422478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.434520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 538/1103] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:49:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:05.440192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:05.539613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39868ff0-fd92-44e1-a19e-52c7c6af6b88 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:05.572864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:05.573491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:05.573771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:05.574045 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:05.580871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:05.582305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:49:05.593373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:05.594229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:05.595664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 566/1104] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:49:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:05.600851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:05.699525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73dc7d9-eb83-4f72-89cc-639dd009c645 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:05.732602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:05.733193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:05.733470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:05.733739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:05.734414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:05.734714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:05.736212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5147538-6591-4207-a5e0-e60b1726fe50 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.747767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 539/1105] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:49:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:05.753809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:05.765181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:05.852793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce7c209-c8b5-4e33-9826-ac3cf2a2b5aa None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:05.884477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:05.885061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:05.885336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:05.885602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:05.886318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] RBAC: Adding query filter params (role.id=4cec4b90840b45179679e5a71a51d668, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=a4e5a17f91134c59bec66f04a175ef05) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:05.886642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:05.888080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b027261-52a6-4de4-a745-3837c13f70a2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:05.894811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 567/1106] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:05 2022] GET /identity/v3/role_assignments?user.id=a4e5a17f91134c59bec66f04a175ef05&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=4cec4b90840b45179679e5a71a51d668 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:49:06.992656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb03f2-b560-414e-ac74-13c5dfe96e22 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:06.993172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb03f2-b560-414e-ac74-13c5dfe96e22 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:06.993266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3eb03f2-b560-414e-ac74-13c5dfe96e22 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:06.994543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 540/1107] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:06.999752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:07.000177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:07.000326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:07.019298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:07.020491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:07.085454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 568/1108] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:07.351949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb03f2-b560-414e-ac74-13c5dfe96e22 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:07.387024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:07.452259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3eb03f2-b560-414e-ac74-13c5dfe96e22 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:07.484695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e97b4a9c-7b82-4ac1-a691-53c009939fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:07.485304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b4a9c-7b82-4ac1-a691-53c009939fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:07.485582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b4a9c-7b82-4ac1-a691-53c009939fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:07.486404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97b4a9c-7b82-4ac1-a691-53c009939fb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:07.487567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b4a9c-7b82-4ac1-a691-53c009939fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:07.489016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e97b4a9c-7b82-4ac1-a691-53c009939fb7 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:07.490567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 541/1109] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:07 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:07.496339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:07.498506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:07.597274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5796c21-2b62-4bfe-aebd-443d458fb474 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:07.631248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d00fcd-f8d3-447a-9c03-05983d7680cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:07.631789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d00fcd-f8d3-447a-9c03-05983d7680cb None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:07.632154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d00fcd-f8d3-447a-9c03-05983d7680cb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:07.632434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d00fcd-f8d3-447a-9c03-05983d7680cb None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:07.633072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d00fcd-f8d3-447a-9c03-05983d7680cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:07.634496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d00fcd-f8d3-447a-9c03-05983d7680cb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:07.655774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 569/1110] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:49:07 2022] POST /identity/v3/users => generated 286 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:49:09.600754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4b05-a429-4f5e-8636-2ffc0fea9a4b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:09.601328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4b05-a429-4f5e-8636-2ffc0fea9a4b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:09.601328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec4b05-a429-4f5e-8636-2ffc0fea9a4b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:09.602638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 542/1111] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:09.607779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:09.608218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:09.608367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:09.627428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:09.628645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:09.680744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:09.695758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 570/1112] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:09.963790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4b05-a429-4f5e-8636-2ffc0fea9a4b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:10.064134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec4b05-a429-4f5e-8636-2ffc0fea9a4b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:10.065599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:10.098466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:10.099078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.099358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.099632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] PATH_INFO: `/v3/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.101015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] RBAC: Authorizing `identity:get_role(role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:10.102368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:10.103681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 543/1113] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:09 2022] GET /identity/v3/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:10.109452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:10.205590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67664c7c-b534-4f47-86e5-a5f69874812d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:10.238107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:10.238714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.238985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.239251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] PATH_INFO: `/v3/users/c4481d65d1d04225a46b232201de5850` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.251641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] RBAC: Authorizing `identity:get_user(user_id=c4481d65d1d04225a46b232201de5850)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:10.253086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:10.254646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 571/1114] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:10 2022] GET /identity/v3/users/c4481d65d1d04225a46b232201de5850 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:10.260348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:10.359836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7cdb42-6234-4ab8-a2ae-729c6a4fbc1c None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:10.391573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:10.392850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.393133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.393512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.430878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:10.458641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:10.460008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:10.554234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 544/1115] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:10 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:10.560161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:10.604931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:10.655636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-106865e9-4687-4b25-a248-bdbe4a724bbc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:10.688458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2db2a7-d4d4-49c1-837f-e628a58c85a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:10.689164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2db2a7-d4d4-49c1-837f-e628a58c85a3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.689439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2db2a7-d4d4-49c1-837f-e628a58c85a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.689707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2db2a7-d4d4-49c1-837f-e628a58c85a3 None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.690802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2db2a7-d4d4-49c1-837f-e628a58c85a3 None admin] RBAC: Authorizing `identity:get_project(project_id=199c72673bf441979fb2d0fba03d0844)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:10.692246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2db2a7-d4d4-49c1-837f-e628a58c85a3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:10.693839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 572/1116] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:10 2022] GET /identity/v3/projects/199c72673bf441979fb2d0fba03d0844 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:10.699864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:10.773319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:10.808767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa4edc-7cfc-415f-bb62-c6d28471186a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:10.840531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:10.841112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:10.841388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:10.841654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:10.842387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] RBAC: Adding query filter params (role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=199c72673bf441979fb2d0fba03d0844, user.id=c4481d65d1d04225a46b232201de5850) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:10.842686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:10.844130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981e3194-2475-4a8a-854b-c248f860e5bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:10.849977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 545/1117] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:10 2022] GET /identity/v3/role_assignments?user.id=c4481d65d1d04225a46b232201de5850&scope.project.id=199c72673bf441979fb2d0fba03d0844&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:12.709320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542849-a8e6-4d20-8288-87259ffb6e3d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.709868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542849-a8e6-4d20-8288-87259ffb6e3d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.709868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25542849-a8e6-4d20-8288-87259ffb6e3d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.711187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 573/1118] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:12.716278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:12.716711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:12.716808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:12.734837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:12.736763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:12.808613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 546/1119] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:13.076161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542849-a8e6-4d20-8288-87259ffb6e3d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:13.176380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25542849-a8e6-4d20-8288-87259ffb6e3d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:13.189875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:13.210380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:13.210992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:13.211266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:13.211534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] PATH_INFO: `/v3/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:13.213041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] RBAC: Authorizing `identity:get_role(role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:13.214395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:13.215700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 574/1120] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:13 2022] GET /identity/v3/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 223 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:13.222117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:13.281145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:13.317897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd98bdb-603e-45e8-9c8f-d2d67ea5fc69 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:13.351546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:13.352188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:13.352465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:13.352736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] PATH_INFO: `/v3/users/c4481d65d1d04225a46b232201de5850` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:13.353832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] RBAC: Authorizing `identity:get_user(user_id=c4481d65d1d04225a46b232201de5850)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:13.355237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:13.356821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 547/1121] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:13 2022] GET /identity/v3/users/c4481d65d1d04225a46b232201de5850 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:13.363023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:13.459241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58d8ba2-bb4a-4f6d-804b-70613e9e83c9 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:13.492018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c0bc21-d4a8-4c1c-980a-86a7653c8874 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:13.492654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bc21-d4a8-4c1c-980a-86a7653c8874 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:13.492931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bc21-d4a8-4c1c-980a-86a7653c8874 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:13.493200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c0bc21-d4a8-4c1c-980a-86a7653c8874 None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:13.494295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0bc21-d4a8-4c1c-980a-86a7653c8874 None admin] RBAC: Authorizing `identity:get_project(project_id=199c72673bf441979fb2d0fba03d0844)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:13.495704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c0bc21-d4a8-4c1c-980a-86a7653c8874 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:13.497322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 575/1122] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:13 2022] GET /identity/v3/projects/199c72673bf441979fb2d0fba03d0844 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:13.503677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:13.600639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297caa3e-cc7a-41eb-b899-27ca839ab434 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:13.628462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:13.633406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048bb4cb-1a73-404c-9312-54ebd4ea72eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:13.634047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb4cb-1a73-404c-9312-54ebd4ea72eb None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:13.634327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb4cb-1a73-404c-9312-54ebd4ea72eb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:13.634601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048bb4cb-1a73-404c-9312-54ebd4ea72eb None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844/users/c4481d65d1d04225a46b232201de5850/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:13.636810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bb4cb-1a73-404c-9312-54ebd4ea72eb None admin] RBAC: Authorizing `identity:create_grant(project_id=199c72673bf441979fb2d0fba03d0844, user_id=c4481d65d1d04225a46b232201de5850, role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:13.638218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-048bb4cb-1a73-404c-9312-54ebd4ea72eb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:13.650346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 548/1123] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:49:13 2022] PUT /identity/v3/projects/199c72673bf441979fb2d0fba03d0844/users/c4481d65d1d04225a46b232201de5850/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:49:15.531661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448dcb-291a-49b5-afe2-aa15d8d7adee None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:15.532807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448dcb-291a-49b5-afe2-aa15d8d7adee None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:15.532936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50448dcb-291a-49b5-afe2-aa15d8d7adee None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:15.534278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 576/1124] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:15.539537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:15.539908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:15.540123 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:15.558143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:15.559317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:15.623928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 549/1125] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:15 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:15.902879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448dcb-291a-49b5-afe2-aa15d8d7adee None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:15.969376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:16.028582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50448dcb-291a-49b5-afe2-aa15d8d7adee None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:16.067135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:16.067758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:16.068071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:16.068333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] PATH_INFO: `/v3/roles/01ee173b9d334328afaa6a3cb4322c77` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:16.069727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] RBAC: Authorizing `identity:get_role(role_id=01ee173b9d334328afaa6a3cb4322c77)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:16.071079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:16.072816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 577/1126] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:15 2022] GET /identity/v3/roles/01ee173b9d334328afaa6a3cb4322c77 => generated 223 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:16.079751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:16.179388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a2dfd0-c643-49b1-be86-b043e71b6b3f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:16.202058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:16.215937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:16.216603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:16.216883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:16.217155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] PATH_INFO: `/v3/users/c4481d65d1d04225a46b232201de5850` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:16.218282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=c4481d65d1d04225a46b232201de5850)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:16.220280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:16.221871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 550/1127] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:16 2022] GET /identity/v3/users/c4481d65d1d04225a46b232201de5850 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:16.227872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:16.341182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae05baad-6b43-4fad-a8cf-de50f2c16095 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:16.360240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:16.377938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:16.378546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:16.378819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:16.379085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:16.457226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:16.458598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:16.555171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 578/1128] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:16.561081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:16.658437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ef3a79-00b1-4200-b383-1d58ead16ba8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:16.691242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35bf513-e6d9-443f-b464-24a755fb43be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:16.691866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bf513-e6d9-443f-b464-24a755fb43be None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:16.692180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bf513-e6d9-443f-b464-24a755fb43be None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:16.692458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35bf513-e6d9-443f-b464-24a755fb43be None admin] PATH_INFO: `/v3/projects/199c72673bf441979fb2d0fba03d0844` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:16.693569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bf513-e6d9-443f-b464-24a755fb43be None admin] RBAC: Authorizing `identity:get_project(project_id=199c72673bf441979fb2d0fba03d0844)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:16.694993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35bf513-e6d9-443f-b464-24a755fb43be None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:16.696668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 551/1129] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:16 2022] GET /identity/v3/projects/199c72673bf441979fb2d0fba03d0844 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:16.702902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:16.721491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:16.800832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666e1824-3b54-4059-863d-b1321c966812 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:16.835505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:16.836129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:16.836411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:16.836681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:16.837427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] RBAC: Adding query filter params (role.id=01ee173b9d334328afaa6a3cb4322c77, scope.project.id=199c72673bf441979fb2d0fba03d0844, user.id=c4481d65d1d04225a46b232201de5850) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:16.837735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:16.839146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8400f4-c1a6-4bd2-99ab-05839421a7c3 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:16.844984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 579/1130] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:16 2022] GET /identity/v3/role_assignments?user.id=c4481d65d1d04225a46b232201de5850&scope.project.id=199c72673bf441979fb2d0fba03d0844&role.id=01ee173b9d334328afaa6a3cb4322c77 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:18.758323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f924e-0cee-4ce0-80fe-ea18576a4f9f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:18.758884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f924e-0cee-4ce0-80fe-ea18576a4f9f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:18.758884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f924e-0cee-4ce0-80fe-ea18576a4f9f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:18.760283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 552/1131] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:18.766099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:18.766535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:18.766667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:18.784616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:18.785784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:18.852737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 580/1132] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:19.121021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f924e-0cee-4ce0-80fe-ea18576a4f9f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:19.180557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:19.223000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f924e-0cee-4ce0-80fe-ea18576a4f9f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:19.256119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002b99b5-8417-4edd-a3c4-b7d19cb947bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:19.256728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b99b5-8417-4edd-a3c4-b7d19cb947bb None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:19.257007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b99b5-8417-4edd-a3c4-b7d19cb947bb None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:19.257280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002b99b5-8417-4edd-a3c4-b7d19cb947bb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:19.258376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b99b5-8417-4edd-a3c4-b7d19cb947bb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:19.259797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002b99b5-8417-4edd-a3c4-b7d19cb947bb None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:19.261412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 553/1133] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:19.267523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:19.281482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:19.366166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2daf95c-2e2b-4b98-8f82-b47d03681a0e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:19.399752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4402ecb-efe2-4389-ad63-cd1a8f7514da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:19.400321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4402ecb-efe2-4389-ad63-cd1a8f7514da None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:19.400602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4402ecb-efe2-4389-ad63-cd1a8f7514da None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:19.400877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4402ecb-efe2-4389-ad63-cd1a8f7514da None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:19.401526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4402ecb-efe2-4389-ad63-cd1a8f7514da None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:19.402953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4402ecb-efe2-4389-ad63-cd1a8f7514da None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:19.428790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 581/1134] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:49:19 2022] POST /identity/v3/projects => generated 311 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:49:21.356199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd266d6-a3b4-412d-9b39-d15c5f82dc1c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:21.356739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd266d6-a3b4-412d-9b39-d15c5f82dc1c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:21.356739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd266d6-a3b4-412d-9b39-d15c5f82dc1c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:21.358083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 554/1135] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:21.363941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:21.364405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:21.364498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:21.382763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:21.383928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:21.440938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:21.450031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 582/1136] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:21.722671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd266d6-a3b4-412d-9b39-d15c5f82dc1c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:21.821275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd266d6-a3b4-412d-9b39-d15c5f82dc1c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:21.846040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:21.854724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729fdc26-047d-4a1f-9ef1-f94cd578f948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:21.855331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fdc26-047d-4a1f-9ef1-f94cd578f948 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:21.855610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fdc26-047d-4a1f-9ef1-f94cd578f948 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:21.855882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729fdc26-047d-4a1f-9ef1-f94cd578f948 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:21.857011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fdc26-047d-4a1f-9ef1-f94cd578f948 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:21.858428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729fdc26-047d-4a1f-9ef1-f94cd578f948 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:21.860033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 555/1137] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:49:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:21.866188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:21.962376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f775510a-2ffc-4bc3-9d1a-113b23166bb8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:21.995868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112bc38e-1a5f-4af1-bbe6-6888e3f41112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:21.996426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bc38e-1a5f-4af1-bbe6-6888e3f41112 None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:21.996700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bc38e-1a5f-4af1-bbe6-6888e3f41112 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:21.996966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112bc38e-1a5f-4af1-bbe6-6888e3f41112 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:21.997596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bc38e-1a5f-4af1-bbe6-6888e3f41112 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:21.999007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112bc38e-1a5f-4af1-bbe6-6888e3f41112 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:22.019351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 583/1138] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:49:21 2022] POST /identity/v3/users => generated 286 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:49:23.958040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929517-9c66-4ed0-9093-5dfa0d75dbeb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:23.958499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929517-9c66-4ed0-9093-5dfa0d75dbeb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:23.958581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3929517-9c66-4ed0-9093-5dfa0d75dbeb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:23.959922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 556/1139] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:23.965182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:23.965615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:23.965706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:23.984082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:23.986086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:24.029910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:24.052002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 584/1140] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:24.320494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929517-9c66-4ed0-9093-5dfa0d75dbeb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:24.419213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3929517-9c66-4ed0-9093-5dfa0d75dbeb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:24.453556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:24.454196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:24.454475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:24.454746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:24.464475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:24.469075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:24.470324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:24.471541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 557/1141] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:24.476316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:24.573287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3869cf-2de0-4a49-8cdb-d17754e01d1e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:24.605872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:24.606466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:24.606746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:24.607017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:24.607684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:24.607988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:24.609408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:24.617819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 585/1142] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:24.623572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:24.678336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:24.721858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfc89aa-5877-4507-b322-482e631993d0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:24.754270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:24.754877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:24.755152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:24.755419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] PATH_INFO: `/v3/users/f206056658284a91b7c493dd8eacbef1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:24.768164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] RBAC: Authorizing `identity:get_user(user_id=f206056658284a91b7c493dd8eacbef1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:24.769574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:24.771176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 558/1143] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:24 2022] GET /identity/v3/users/f206056658284a91b7c493dd8eacbef1 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:24.777110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:24.820857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:24.877443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f498792-85b5-4007-a234-bbee0397bdad None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:24.911584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:24.912214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:24.912490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:24.912757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:24.978216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:24.979652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:25.019612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:25.074620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 586/1144] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:25.080603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:25.176969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39eb6f42-a2aa-471c-931d-28487d241dd9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:25.189657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:25.210798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d908ba75-3727-4e32-a34f-dba6ab69347f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:25.211417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ba75-3727-4e32-a34f-dba6ab69347f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:25.211695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ba75-3727-4e32-a34f-dba6ab69347f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:25.211968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d908ba75-3727-4e32-a34f-dba6ab69347f None admin] PATH_INFO: `/v3/projects/2800bd9890d6472e82230ffa47ea2f42` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:25.213092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908ba75-3727-4e32-a34f-dba6ab69347f None admin] RBAC: Authorizing `identity:get_project(project_id=2800bd9890d6472e82230ffa47ea2f42)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:25.214512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d908ba75-3727-4e32-a34f-dba6ab69347f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:25.216143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 559/1145] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:25 2022] GET /identity/v3/projects/2800bd9890d6472e82230ffa47ea2f42 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:25.222834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:25.318428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3972a7d-4a83-40a9-837c-c24458116706 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:25.352628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:25.353212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:25.353487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:25.353753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:25.354466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=2800bd9890d6472e82230ffa47ea2f42, user.id=f206056658284a91b7c493dd8eacbef1) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:25.354766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:25.356193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d768b6e-100a-4692-962f-ffa1a0df32dd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:25.361479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 587/1146] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:25 2022] GET /identity/v3/role_assignments?user.id=f206056658284a91b7c493dd8eacbef1&scope.project.id=2800bd9890d6472e82230ffa47ea2f42&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:27.224114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3db3-1080-4248-b8c3-3158deef02a5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.224610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3db3-1080-4248-b8c3-3158deef02a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.224610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfac3db3-1080-4248-b8c3-3158deef02a5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.225925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 560/1147] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:27.230973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.231386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.231523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.244888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:27.250367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:27.251554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:27.319141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 588/1148] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:27.583998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3db3-1080-4248-b8c3-3158deef02a5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:27.686296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfac3db3-1080-4248-b8c3-3158deef02a5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:27.720400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:27.721012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.721293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.721568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.731348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:27.736058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:27.737174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:27.738377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 561/1149] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:27.743136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:27.838804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514348c2-37ad-4fc7-b40b-6499e890a224 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:27.871051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:27.871645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:27.871922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:27.872225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:27.872884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:27.873183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:27.874535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:27.877464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:27.883835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 589/1150] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:27.889940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:27.931346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:27.988294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2988a998-2311-4409-aab7-45fd49dcc984 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:28.022217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:28.022833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:28.023110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:28.023381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] PATH_INFO: `/v3/users/f206056658284a91b7c493dd8eacbef1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:28.024498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] RBAC: Authorizing `identity:get_user(user_id=f206056658284a91b7c493dd8eacbef1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:28.025918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:28.027481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 562/1151] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:27 2022] GET /identity/v3/users/f206056658284a91b7c493dd8eacbef1 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:28.033334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:28.130211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6b8f20-f859-4085-ac02-f83150a431b2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:28.162221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c832e89a-09e9-4ec5-ac34-9075f219ea3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:28.162832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e89a-09e9-4ec5-ac34-9075f219ea3f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:28.163109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e89a-09e9-4ec5-ac34-9075f219ea3f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:28.163380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c832e89a-09e9-4ec5-ac34-9075f219ea3f None admin] PATH_INFO: `/v3/projects/2800bd9890d6472e82230ffa47ea2f42` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:28.164506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832e89a-09e9-4ec5-ac34-9075f219ea3f None admin] RBAC: Authorizing `identity:get_project(project_id=2800bd9890d6472e82230ffa47ea2f42)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:28.165917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c832e89a-09e9-4ec5-ac34-9075f219ea3f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:28.167511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 590/1152] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:28 2022] GET /identity/v3/projects/2800bd9890d6472e82230ffa47ea2f42 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:28.173860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:28.271354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe1fd81-edfb-4578-9908-ca4bb2230392 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:28.279755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:28.304776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaa8d1c-fd8c-405b-93bd-57cefebc8188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:28.305412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa8d1c-fd8c-405b-93bd-57cefebc8188 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:28.305687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa8d1c-fd8c-405b-93bd-57cefebc8188 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:28.305956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaa8d1c-fd8c-405b-93bd-57cefebc8188 None admin] PATH_INFO: `/v3/projects/2800bd9890d6472e82230ffa47ea2f42/users/f206056658284a91b7c493dd8eacbef1/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:28.307807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa8d1c-fd8c-405b-93bd-57cefebc8188 None admin] RBAC: Authorizing `identity:create_grant(project_id=2800bd9890d6472e82230ffa47ea2f42, user_id=f206056658284a91b7c493dd8eacbef1, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:28.309244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efaa8d1c-fd8c-405b-93bd-57cefebc8188 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:28.322305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 563/1153] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:49:28 2022] PUT /identity/v3/projects/2800bd9890d6472e82230ffa47ea2f42/users/f206056658284a91b7c493dd8eacbef1/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:49:30.211053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175ea7-fe88-4ca1-8653-76872cbb4a17 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.211612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175ea7-fe88-4ca1-8653-76872cbb4a17 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.211612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9175ea7-fe88-4ca1-8653-76872cbb4a17 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.212892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 591/1154] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:30.218087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.218534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.218640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.237169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:30.238331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:30.302535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 564/1155] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:30.574585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175ea7-fe88-4ca1-8653-76872cbb4a17 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:30.640807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:30.677013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9175ea7-fe88-4ca1-8653-76872cbb4a17 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:30.711286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:30.711908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.712222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.712499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.722863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:30.727562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:30.728654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:30.729649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 592/1156] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:30.734915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:30.827844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:30.831664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1528b01-b51f-4b7b-a7c5-9979a347ac79 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:30.866312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:30.866902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:30.867183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:30.867458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:30.868149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:30.868455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:30.869813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:30.877609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 565/1157] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:30.883346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:30.983037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c836d2ce-a4ba-4e08-b5df-48b399be2559 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:31.010448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:31.020288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:31.020910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:31.021189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:31.021462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] PATH_INFO: `/v3/users/f206056658284a91b7c493dd8eacbef1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:31.022577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] RBAC: Authorizing `identity:get_user(user_id=f206056658284a91b7c493dd8eacbef1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:31.024003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:31.025612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 593/1158] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:30 2022] GET /identity/v3/users/f206056658284a91b7c493dd8eacbef1 => generated 286 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:31.031565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:31.129658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c535a8f-2ded-4f9f-a571-2fc6b51e7ada None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:31.162180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:31.162765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:31.163041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:31.163309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:31.190492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:31.227967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:31.229419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:31.323361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 566/1159] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:31.329886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:31.427279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10610e77-8f4a-4112-8008-16b7ebd2a9ea None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:31.460215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e3bbda-58ce-42fc-8aec-ca7c720b9be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:31.460827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3bbda-58ce-42fc-8aec-ca7c720b9be6 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:31.461099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3bbda-58ce-42fc-8aec-ca7c720b9be6 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:31.461365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e3bbda-58ce-42fc-8aec-ca7c720b9be6 None admin] PATH_INFO: `/v3/projects/2800bd9890d6472e82230ffa47ea2f42` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:31.462441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3bbda-58ce-42fc-8aec-ca7c720b9be6 None admin] RBAC: Authorizing `identity:get_project(project_id=2800bd9890d6472e82230ffa47ea2f42)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:31.463847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e3bbda-58ce-42fc-8aec-ca7c720b9be6 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:31.465455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 594/1160] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:31 2022] GET /identity/v3/projects/2800bd9890d6472e82230ffa47ea2f42 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:31.472238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:31.529414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:31.569039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5432c212-5fed-4f62-adb7-9de263d9bda8 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:31.602691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:31.603271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:31.603555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:31.603827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:31.604571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=2800bd9890d6472e82230ffa47ea2f42, user.id=f206056658284a91b7c493dd8eacbef1) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:31.604878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:31.606276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3a4845-4ea7-4da8-b9c8-3a55a3ea21f0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:31.612623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 567/1161] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:31 2022] GET /identity/v3/role_assignments?user.id=f206056658284a91b7c493dd8eacbef1&scope.project.id=2800bd9890d6472e82230ffa47ea2f42&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:33.526298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4076d-39b2-4d7e-8e84-98003db7e5ca None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:33.526821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4076d-39b2-4d7e-8e84-98003db7e5ca None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:33.526821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4076d-39b2-4d7e-8e84-98003db7e5ca None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:33.528198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 595/1162] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:33.533463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:33.533866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:33.534009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:33.552101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:33.553272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:33.617173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 568/1163] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 25 02:49:33.881722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4076d-39b2-4d7e-8e84-98003db7e5ca None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:33.944318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:33.983970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c4076d-39b2-4d7e-8e84-98003db7e5ca None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:34.017602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:34.018196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:34.018472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:34.018739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:34.082661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:34.084109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:34.140560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:34.178965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 596/1164] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:34.184885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:34.237918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:34.280989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14549094-832e-4277-8e6a-ee8e4f66ccbe None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:34.313685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:34.314297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:34.314581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:34.314920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:34.321282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:34.322702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-e836f7d8-e9de-4a1e-bed9-4df0924e7dce None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:34.334224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:34.335414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:34.336328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 569/1165] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:49:34 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:34.341414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:34.437775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09906de-c3df-48bd-ae4f-b0ded7497ad4 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:34.471026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:34.471617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:34.471894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:34.472194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:34.472831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:34.473136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:34.474488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57a246e-9dbf-4b87-a76a-514db7751728 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:34.481377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 597/1166] 10.222.0.72 () {56 vars in 1115 bytes} [Thu Aug 25 02:49:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:36.363737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da561d-3958-4c4d-8eec-deb3aeb7dd85 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:36.364290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da561d-3958-4c4d-8eec-deb3aeb7dd85 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:36.364290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86da561d-3958-4c4d-8eec-deb3aeb7dd85 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:36.365665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 570/1167] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:36.370885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb898af-eb0a-4b9a-959b-be5917d449c6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:36.371296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb898af-eb0a-4b9a-959b-be5917d449c6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:36.371430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb898af-eb0a-4b9a-959b-be5917d449c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:36.389303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bbb898af-eb0a-4b9a-959b-be5917d449c6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:36.390468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bbb898af-eb0a-4b9a-959b-be5917d449c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:36.411465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:36.456387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 598/1168] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:36.725819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da561d-3958-4c4d-8eec-deb3aeb7dd85 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:36.825480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86da561d-3958-4c4d-8eec-deb3aeb7dd85 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:36.839522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:36.859132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8986389a-2a37-4e48-97f2-71f25d3c1187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:36.859875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986389a-2a37-4e48-97f2-71f25d3c1187 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:36.860177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986389a-2a37-4e48-97f2-71f25d3c1187 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:36.860452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8986389a-2a37-4e48-97f2-71f25d3c1187 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:36.861112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986389a-2a37-4e48-97f2-71f25d3c1187 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:36.862454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8986389a-2a37-4e48-97f2-71f25d3c1187 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:36.878185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 571/1169] 10.222.0.72 () {60 vars in 1138 bytes} [Thu Aug 25 02:49:36 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:49:38.793062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb40cbd-813c-45c1-bf63-fccff974e3fd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:38.793689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb40cbd-813c-45c1-bf63-fccff974e3fd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:38.793689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb40cbd-813c-45c1-bf63-fccff974e3fd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:38.794936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 599/1170] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:38.800174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:38.800611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:38.800751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:38.818366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:38.819545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:38.883551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 572/1171] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:39.161445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb40cbd-813c-45c1-bf63-fccff974e3fd None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:39.259952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb40cbd-813c-45c1-bf63-fccff974e3fd None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:39.292864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1638be34-5597-4a31-8801-1e789a280d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:39.293471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638be34-5597-4a31-8801-1e789a280d58 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:39.293745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638be34-5597-4a31-8801-1e789a280d58 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:39.294013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1638be34-5597-4a31-8801-1e789a280d58 None admin] PATH_INFO: `/v3/domains/5bc5eaa9727248fa9697930ef3ee1369` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:39.304466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638be34-5597-4a31-8801-1e789a280d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5bc5eaa9727248fa9697930ef3ee1369)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:39.305876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1638be34-5597-4a31-8801-1e789a280d58 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:39.307432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 600/1172] 10.222.0.72 () {56 vars in 1183 bytes} [Thu Aug 25 02:49:39 2022] GET /identity/v3/domains/5bc5eaa9727248fa9697930ef3ee1369 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:39.313857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:39.410207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4a8aa1-ad8f-47fa-9840-d2f62254a14d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:39.412479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:39.445382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab8d9d-935b-453b-9302-416234290cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:39.445969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8d9d-935b-453b-9302-416234290cdc None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:39.446242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8d9d-935b-453b-9302-416234290cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:39.446511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab8d9d-935b-453b-9302-416234290cdc None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:39.447143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab8d9d-935b-453b-9302-416234290cdc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:39.448566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab8d9d-935b-453b-9302-416234290cdc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:39.474307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 573/1173] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:49:39 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:49:41.402219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9323ed-e787-49ae-8726-43344e2ffb5c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:41.402767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9323ed-e787-49ae-8726-43344e2ffb5c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:41.402767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9323ed-e787-49ae-8726-43344e2ffb5c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:41.404138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 601/1174] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:41.409943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:41.410432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:41.410531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:41.428738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:41.429921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:41.494467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 574/1175] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:41.778561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9323ed-e787-49ae-8726-43344e2ffb5c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:41.797904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:41.882777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9323ed-e787-49ae-8726-43344e2ffb5c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:41.916947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed4ee6-5ebf-4924-b45d-1f0401fa8bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:41.917570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4ee6-5ebf-4924-b45d-1f0401fa8bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:41.917846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4ee6-5ebf-4924-b45d-1f0401fa8bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:41.918112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed4ee6-5ebf-4924-b45d-1f0401fa8bb7 None admin] PATH_INFO: `/v3/domains/5bc5eaa9727248fa9697930ef3ee1369` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:41.919207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed4ee6-5ebf-4924-b45d-1f0401fa8bb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=5bc5eaa9727248fa9697930ef3ee1369)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:41.920656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aed4ee6-5ebf-4924-b45d-1f0401fa8bb7 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:41.923168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 602/1176] 10.222.0.72 () {56 vars in 1183 bytes} [Thu Aug 25 02:49:41 2022] GET /identity/v3/domains/5bc5eaa9727248fa9697930ef3ee1369 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:41.930591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:42.019477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:42.035374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62845b1-bfc5-4d7a-928e-8f7d055b69a6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:42.068215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b159f8a0-0a52-4903-85c7-510452bae40c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:42.068807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f8a0-0a52-4903-85c7-510452bae40c None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:42.069086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f8a0-0a52-4903-85c7-510452bae40c None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:42.069359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b159f8a0-0a52-4903-85c7-510452bae40c None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:42.069989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159f8a0-0a52-4903-85c7-510452bae40c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:42.071405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b159f8a0-0a52-4903-85c7-510452bae40c None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:42.091989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 575/1177] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:49:41 2022] POST /identity/v3/users => generated 311 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:49:44.039413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf8c35-1992-41b2-a3f7-fff91dd69e3c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:44.039949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf8c35-1992-41b2-a3f7-fff91dd69e3c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:44.039949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf8c35-1992-41b2-a3f7-fff91dd69e3c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:44.041421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 603/1178] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:44.046537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:44.046966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:44.047181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:44.064707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:44.065876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:44.131087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 576/1179] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:44.399789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf8c35-1992-41b2-a3f7-fff91dd69e3c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:44.482103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:44.498480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf8c35-1992-41b2-a3f7-fff91dd69e3c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:44.532460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:44.533074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:44.533355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:44.533627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:44.543530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:44.548335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:44.549350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:44.550234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 604/1180] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:44.555385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:44.624367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:44.654428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3430f2-f79e-42b7-b408-73fc310f5bac None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:44.686807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:44.687498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:44.687772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:44.688068 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:44.688721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:44.689020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:44.690364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:44.698035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 577/1181] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:44.704365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:44.800682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e83f23e-da2b-4c5e-b2cd-6e845f7a633d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:44.833440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:44.834043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:44.834320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:44.834592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] PATH_INFO: `/v3/users/2483f52d63d24da5928d51575e7788d8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:44.847530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] RBAC: Authorizing `identity:get_user(user_id=2483f52d63d24da5928d51575e7788d8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:44.849032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:44.850585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 605/1182] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:44 2022] GET /identity/v3/users/2483f52d63d24da5928d51575e7788d8 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:44.856375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:44.953820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85d6918-5758-4103-86e0-229f08097c3b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:44.986446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:44.987025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:44.987297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:44.987565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:44.990079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:45.054159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:45.055581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:45.155987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 578/1183] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:45.161798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:45.164699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:45.258727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b53fe85-7a7f-4317-b4d8-1a6015873204 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:45.292000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4a0661-4d94-44cc-9755-06a7470a13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:45.292632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a0661-4d94-44cc-9755-06a7470a13f0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:45.292905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a0661-4d94-44cc-9755-06a7470a13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:45.293171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4a0661-4d94-44cc-9755-06a7470a13f0 None admin] PATH_INFO: `/v3/projects/7ee23f8f29084436a9f659fe276b3f84` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:45.294243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a0661-4d94-44cc-9755-06a7470a13f0 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee23f8f29084436a9f659fe276b3f84)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:45.295661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4a0661-4d94-44cc-9755-06a7470a13f0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:45.298073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 606/1184] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:45 2022] GET /identity/v3/projects/7ee23f8f29084436a9f659fe276b3f84 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:45.304183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:45.336213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:45.401434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476b30b4-a07e-4566-aa3e-6dcd5891bfb5 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:45.433872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:45.434457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:45.434735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:45.435008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:45.435725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=7ee23f8f29084436a9f659fe276b3f84, user.id=2483f52d63d24da5928d51575e7788d8) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:45.436032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:45.437598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00203482-1777-4797-bb72-34e5557c8943 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:45.442790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 579/1185] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:45 2022] GET /identity/v3/role_assignments?user.id=2483f52d63d24da5928d51575e7788d8&scope.project.id=7ee23f8f29084436a9f659fe276b3f84&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:47.321075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c6fd-b300-4391-8c42-c09978261484 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:47.321608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c6fd-b300-4391-8c42-c09978261484 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:47.321608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df45c6fd-b300-4391-8c42-c09978261484 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:47.322893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 607/1186] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:47.328296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:47.328664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:47.328837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:47.346963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:47.348199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:47.413223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 580/1187] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:47.680576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c6fd-b300-4391-8c42-c09978261484 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:47.749657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:47.781897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df45c6fd-b300-4391-8c42-c09978261484 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:47.813961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:47.814582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:47.814862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:47.815134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:47.824858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:47.830081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:47.831175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:49:47.832210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 608/1188] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:47.837409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:47.864618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:47.933720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b078d2-0407-43c6-9bb7-d39cab5a672b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:47.966816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:47.967414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:47.967691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:47.967963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:47.969431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:47.969737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:47.971096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:47.979090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 581/1189] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:47.985000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:48.082410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ece0ac-7c2b-4fed-a8e3-c928afa9bf69 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:48.109454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:48.115412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:48.116024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:48.116329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:48.116598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] PATH_INFO: `/v3/users/2483f52d63d24da5928d51575e7788d8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:48.117692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] RBAC: Authorizing `identity:get_user(user_id=2483f52d63d24da5928d51575e7788d8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:48.119107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:48.120683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 609/1190] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:47 2022] GET /identity/v3/users/2483f52d63d24da5928d51575e7788d8 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:48.127207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:48.216118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:48.225632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9790cbd4-ef42-4a32-b3f6-8a4140d1aced None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:48.258346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c897251b-6158-4779-b226-2b54700f4822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:48.258958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897251b-6158-4779-b226-2b54700f4822 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:48.259236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897251b-6158-4779-b226-2b54700f4822 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:48.259506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897251b-6158-4779-b226-2b54700f4822 None admin] PATH_INFO: `/v3/projects/7ee23f8f29084436a9f659fe276b3f84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:48.260617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897251b-6158-4779-b226-2b54700f4822 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee23f8f29084436a9f659fe276b3f84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:48.262029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c897251b-6158-4779-b226-2b54700f4822 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:48.263900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 582/1191] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:48 2022] GET /identity/v3/projects/7ee23f8f29084436a9f659fe276b3f84 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:48.270688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:48.371567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd266b6-d90a-403c-913f-4785b4e78d43 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:48.404954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f644e-9d90-493e-ab89-e8c4421c52cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:48.405596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f644e-9d90-493e-ab89-e8c4421c52cd None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:48.405978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f644e-9d90-493e-ab89-e8c4421c52cd None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:48.406258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f644e-9d90-493e-ab89-e8c4421c52cd None admin] PATH_INFO: `/v3/projects/7ee23f8f29084436a9f659fe276b3f84/users/2483f52d63d24da5928d51575e7788d8/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:48.408166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f644e-9d90-493e-ab89-e8c4421c52cd None admin] RBAC: Authorizing `identity:create_grant(project_id=7ee23f8f29084436a9f659fe276b3f84, user_id=2483f52d63d24da5928d51575e7788d8, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:48.409592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1f644e-9d90-493e-ab89-e8c4421c52cd None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:48.422144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 610/1192] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:49:48 2022] PUT /identity/v3/projects/7ee23f8f29084436a9f659fe276b3f84/users/2483f52d63d24da5928d51575e7788d8/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:49:50.297982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827f86-13be-417c-9fed-d6bcb46a7e45 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:50.298476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827f86-13be-417c-9fed-d6bcb46a7e45 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:50.298476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62827f86-13be-417c-9fed-d6bcb46a7e45 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:50.299792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 583/1193] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:49:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:49:50.304891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:50.305289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:50.305439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:50.322912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:49:50.324115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:49:50.377053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:50.391271 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 611/1194] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:49:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:49:50.659023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827f86-13be-417c-9fed-d6bcb46a7e45 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:50.757373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62827f86-13be-417c-9fed-d6bcb46a7e45 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:50.790286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:50.790889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:50.791166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:50.791436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:50.801102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:49:50.805687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:49:50.806764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:49:50.807601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 584/1195] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:49:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:49:50.812824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:50.908651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a11b689-5f79-43f9-9dd0-0d350b075d05 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:50.940879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:50.941485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:50.941763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:50.942035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:50.942713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:50.943036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:50.944443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:50.952546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 612/1196] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:49:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:50.958995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:50.978301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:51.055514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a063a7aa-082d-4197-9115-ed7da2ce3454 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:51.088302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:51.088901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:51.089176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:51.089444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] PATH_INFO: `/v3/users/2483f52d63d24da5928d51575e7788d8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:51.090534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] RBAC: Authorizing `identity:get_user(user_id=2483f52d63d24da5928d51575e7788d8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:51.091938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:51.093544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 585/1197] 10.222.0.72 () {56 vars in 1177 bytes} [Thu Aug 25 02:49:50 2022] GET /identity/v3/users/2483f52d63d24da5928d51575e7788d8 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:51.099391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:51.149605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:51.199051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19743d5d-d13f-4396-a435-6f660faf8074 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:51.231494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:51.232116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:51.232396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:51.232664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:51.297213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:51.298811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:51.345466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:51.394904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 613/1198] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:49:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:49:51.400858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:51.482861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:49:51.498544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14cd95a-1184-4aaf-8d39-d778daba7813 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:51.531449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126edd50-61f3-4b67-88a9-775062923131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:51.532083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edd50-61f3-4b67-88a9-775062923131 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:51.532363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edd50-61f3-4b67-88a9-775062923131 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:51.532636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126edd50-61f3-4b67-88a9-775062923131 None admin] PATH_INFO: `/v3/projects/7ee23f8f29084436a9f659fe276b3f84` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:51.533736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126edd50-61f3-4b67-88a9-775062923131 None admin] RBAC: Authorizing `identity:get_project(project_id=7ee23f8f29084436a9f659fe276b3f84)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:51.535162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126edd50-61f3-4b67-88a9-775062923131 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:51.536808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 586/1199] 10.222.0.72 () {56 vars in 1186 bytes} [Thu Aug 25 02:49:51 2022] GET /identity/v3/projects/7ee23f8f29084436a9f659fe276b3f84 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:49:51.542919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:49:51.641727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e232ba48-aace-47b4-a7c7-c5379a16c7a1 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:49:51.675128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:49:51.675723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:49:51.676004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:49:51.676309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:49:51.677035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=7ee23f8f29084436a9f659fe276b3f84, user.id=2483f52d63d24da5928d51575e7788d8) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:49:51.677342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:49:51.678760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aed4500-e0a1-4cf9-8e9e-27672b35624b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:49:51.684393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 614/1200] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:49:51 2022] GET /identity/v3/role_assignments?user.id=2483f52d63d24da5928d51575e7788d8&scope.project.id=7ee23f8f29084436a9f659fe276b3f84&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:01.527338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=23 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:01.681816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:47.252356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0030ac-7f60-4001-b9aa-d1647f249844 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:47.252913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0030ac-7f60-4001-b9aa-d1647f249844 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:47.252913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0030ac-7f60-4001-b9aa-d1647f249844 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:47.255472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 587/1201] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:50:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:47.259926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:47.260416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:47.260502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:47.280248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:47.281436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:47.368654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 615/1202] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:50:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:50:47.657201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0030ac-7f60-4001-b9aa-d1647f249844 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:47.803541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0030ac-7f60-4001-b9aa-d1647f249844 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:47.857462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:47.858545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:47.859047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:47.859538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:47.872707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:47.874619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:50:47.912102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:47.913345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:50:47.914318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:50:47.914318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:47.914318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:50:47.914318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 588/1203] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:47.920008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:48.060870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ef181a-c6b6-46be-bc76-e7916db38088 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:48.095311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:48.102191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:48.103104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:48.103599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:48.104133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:48.104992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:48.105498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:48.107156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed13d5b7-3e1d-47b8-a253-24cccc12e8b9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:48.120562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 616/1204] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:50:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:48.126973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:48.203556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:48.269939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f102ed-1401-4191-b3a9-e3ad1e97cce0 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:48.309438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7f8a8-50a4-4172-a050-799b27c714de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:48.310807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7f8a8-50a4-4172-a050-799b27c714de None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:48.311324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7f8a8-50a4-4172-a050-799b27c714de None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:48.311828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7f8a8-50a4-4172-a050-799b27c714de None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:48.312804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7f8a8-50a4-4172-a050-799b27c714de None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:48.314450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7f8a8-50a4-4172-a050-799b27c714de None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:48.345994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 589/1205] 10.222.0.72 () {60 vars in 1132 bytes} [Thu Aug 25 02:50:48 2022] POST /identity/v3/users => generated 251 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 02:50:50.567186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad5d93-30bb-4d97-90e9-a89b17937f7b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:50.567759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad5d93-30bb-4d97-90e9-a89b17937f7b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:50.567759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ad5d93-30bb-4d97-90e9-a89b17937f7b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:50.569447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 617/1206] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:50:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:50.574919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:50.575928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:50.576201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:50.596912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:50.598117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:50.678253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 590/1207] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:50:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:50:50.976853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad5d93-30bb-4d97-90e9-a89b17937f7b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:51.105124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ad5d93-30bb-4d97-90e9-a89b17937f7b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:51.153202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:51.153869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:51.154155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:51.154420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:51.166546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:50:51.171341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:51.172417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:50:51.173264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:51.177523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 618/1208] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:50:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:51.179211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:51.228309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:51.296672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-022b8cb2-4692-4ad5-a9cb-dd338e157bec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:51.339906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:51.340647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:51.341041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:51.341343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:51.342136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:51.342433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:51.343786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:51.354231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 591/1209] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:50:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:51.360756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:51.421256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:51.484021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4726aab6-cef3-4c1c-a11c-12a4a5661d54 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:51.527164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:51.527952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:51.528974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:51.528974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:51.541434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:51.543208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:50:51.563960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:51.565091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:50:51.566086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:50:51.566086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:51.566086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:51.566086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 619/1210] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:51.572390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:51.686809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:51.690412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e7475-279b-4904-b094-b845d99c3a24 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:51.729989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:51.730617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:51.730946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:51.731251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:51.731958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:51.732370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:51.733693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:51.752131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 592/1211] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:50:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:51.753360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:51.871827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c8c059-6567-4913-a214-eceb40882fdf None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:51.874270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:51.914779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:51.915935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:51.916475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:51.916968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:51.927012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:51.928870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:50:51.942722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:51.943937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:50:51.945062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:51.949997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:51.950211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 620/1212] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:51 2022] GET /identity/v3/users/placement => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:50:52.066921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b065a677-bf43-42b6-a936-e71ed7b12204 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:52.105395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:52.106208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:52.107091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:52.108453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:52.109279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:52.109691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:52.111233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:52.132501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 593/1213] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Aug 25 02:50:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:52.139926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:52.275248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc87eea-800f-4293-883e-f6d2f5fdf838 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:52.318828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:52.319386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:52.319732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:52.319991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:52.361620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:52.406345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:52.407868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:52.513579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 621/1214] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:50:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:50:52.520553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:52.541052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:52.628267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d4020-b4be-4797-8fba-48b5e53b4e22 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:52.664840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:52.665479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:52.665754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:52.666051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:52.676976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:52.678475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:50:52.694425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:52.696076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:50:52.697190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:50:52.697190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:52.697190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:50:52.703514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 594/1215] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:52.703670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:52.766929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:52.810705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782e7abd-c9c9-42ed-bdce-40218eb6b76c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:52.851291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:52.852631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:52.852631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:52.852803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:52.853348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:52.853725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:52.855230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:52.872635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 622/1216] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:50:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:52.874644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:52.953618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:52.988017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733a43a-d822-48ec-aafb-2e5268cd7aaa None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:53.028247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:53.029161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:53.029529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:53.029869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:53.038062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:53.039718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:50:53.054084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:53.055102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:50:53.056718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 595/1217] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:50:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:53.062737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:53.187407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ddbc1e-a935-4217-977b-cffb55411719 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:53.214100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:53.228629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:53.229299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:53.229576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:53.229838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:53.230687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:53.231097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:53.233013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee977726-b4e5-4948-9d42-04cef0c63fd8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:53.253059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 623/1218] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:50:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:50:53.259384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:53.397916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6646bd06-2991-4d71-8b69-08e4b3f59e0b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:53.430915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:53.438054 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:53.438736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:53.439072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:53.439348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:53.440202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:53.440535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:53.442028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdbac77-0c43-45ab-89bb-f9781b8cb90b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:53.447793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 596/1219] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:50:53 2022] GET /identity/v3/role_assignments?user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:50:55.411101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de1b16-779d-4648-abf3-412050076fb9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:55.411667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de1b16-779d-4648-abf3-412050076fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:55.411667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60de1b16-779d-4648-abf3-412050076fb9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:55.413014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 624/1220] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:50:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:50:55.418043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:55.418448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:55.418593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:55.436818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:55.438011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:55.511852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 597/1221] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:50:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:50:55.781391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de1b16-779d-4648-abf3-412050076fb9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:55.888318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60de1b16-779d-4648-abf3-412050076fb9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:55.923105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:55.923734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:55.924016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:55.924319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] PATH_INFO: `/v3/roles/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:55.935234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:50:55.940634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:55.941522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:55.942549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 625/1222] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:50:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:55.948024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.062416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939356da-95fb-4c01-bf94-2590fa616bb2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.089026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:56.102191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.102927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.103239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.103551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.104411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] RBAC: Adding query filter params (name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:56.104724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.106474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:56.115818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 598/1223] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:50:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:56.121720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.172195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:56.235212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0052fb4-4187-4a00-8a87-8c810d168b9b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.272897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.273526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.273836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.274076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.284318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.285769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:50:56.300875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:56.302026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:50:56.307954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:50:56.307954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:56.307954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:56.307954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 626/1224] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:56.308258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.420815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2111b8-4e7f-466b-960b-9c5043dde37b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.457016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.457735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.458088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.458366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.459143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:56.459447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.460983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:56.474186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 599/1225] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:50:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:50:56.479888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.580945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:56.587954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c350ab-4717-4fb7-b23f-7b51577f8135 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.623681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.624467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.624605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.624867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.632550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.633972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:50:56.645843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:56.646868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:56.647864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 627/1226] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:56.653759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.706244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:56.768909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e82a978-707d-41b0-8b6e-5dab0e4be460 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.803619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.804260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.804540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.804813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.805696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:56.806063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.807724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:56.827540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 600/1227] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Aug 25 02:50:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:56.833842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:56.946406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b3c854-5c9d-4e15-9987-45da05bd2273 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:56.985773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:56.986296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:56.986572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:56.986838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:56.998174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:56.999620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:50:57.014587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:57.015816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:50:57.017224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:50:57.017224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:50:57.017224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:57.017224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 628/1228] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:50:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:50:57.022089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:57.137122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9637cb-be47-401e-8e0a-ac9f86f935b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:57.139852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:57.179339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:57.179948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:57.180269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:57.180537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:57.181178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:57.181484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:57.182846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:57.195826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 601/1229] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:50:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:57.202018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:57.211943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:57.314927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-938bcf7f-0227-405f-af27-48448ab85717 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:57.355791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:57.356839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:57.357073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:57.357425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:57.366127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:57.367898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:50:57.382573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:50:57.383687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:50:57.384639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 629/1230] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:50:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:50:57.390455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:57.496090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042b1938-7bcb-45b6-b3a4-95de6a00b4f2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:57.534749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:57.535384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:57.535662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:57.535930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:57.536666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:50:57.536955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:57.538375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce2f6fc-d0f0-489d-988c-861936a225f8 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:57.551191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 602/1231] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:50:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:50:57.557594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:50:57.629354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:50:57.666778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192f24-1e13-4d75-b0b7-d07e1e84126f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:50:57.705516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1be1bf-d4d4-4aac-ae62-0d680bc8d828 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:50:57.706228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1be1bf-d4d4-4aac-ae62-0d680bc8d828 None admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:57.706511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1be1bf-d4d4-4aac-ae62-0d680bc8d828 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:57.706828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1be1bf-d4d4-4aac-ae62-0d680bc8d828 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/526b8be76d1c4c1fbcc1c3ae97c5ead4/roles/9d127b3c860443b7850907f65964f68b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:57.724538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1be1bf-d4d4-4aac-ae62-0d680bc8d828 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=526b8be76d1c4c1fbcc1c3ae97c5ead4, role_id=9d127b3c860443b7850907f65964f68b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:50:57.725991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb1be1bf-d4d4-4aac-ae62-0d680bc8d828 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:50:57.738538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 630/1232] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:50:57 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/526b8be76d1c4c1fbcc1c3ae97c5ead4/roles/9d127b3c860443b7850907f65964f68b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:50:59.691987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f62f3-ce6c-450f-a630-95d504307955 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:59.692885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f62f3-ce6c-450f-a630-95d504307955 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:59.692885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f62f3-ce6c-450f-a630-95d504307955 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:59.694092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 603/1233] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:50:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:50:59.701557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:50:59.702148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:50:59.702229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:50:59.721161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:50:59.722362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:50:59.798963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 631/1234] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:50:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:00.070916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f62f3-ce6c-450f-a630-95d504307955 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:00.099659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:00.187686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f62f3-ce6c-450f-a630-95d504307955 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:00.227615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:00.228336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:00.228645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:00.229043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] PATH_INFO: `/v3/roles/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:00.241518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:51:00.246644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:00.247760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:00.248865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 604/1235] 10.222.0.72 () {56 vars in 1102 bytes} [Thu Aug 25 02:51:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:51:00.254180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:00.305468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:00.369192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5042316-a425-4a1f-82d9-2dea678fc181 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:00.412151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:00.412763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:00.413045 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:00.413318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:00.414017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] RBAC: Adding query filter params (name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:00.414320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:00.415692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:00.429935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 632/1236] 10.222.0.72 () {56 vars in 1103 bytes} [Thu Aug 25 02:51:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:00.431264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:00.531760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:00.549105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533aa301-64b2-4cdc-abcc-dbd81f9d89ce None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:00.587677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:00.588428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:00.588720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:00.589000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:00.600806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:00.602388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:00.619165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:00.620449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:00.621571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:00.621571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:00.621571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:00.623420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 605/1237] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:00.629600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:00.740377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4abe3f-f26c-4dad-ad60-23f2415da001 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:00.750519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:00.780533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:00.781150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:00.781436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:00.781751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:00.782469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:00.782776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:00.784250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:00.797245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 633/1238] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:51:00.803021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:00.914433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3f6525-f849-41b0-b5a1-3d70c89872b2 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:00.952107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf3564-0012-44da-98ad-324227667867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:00.952743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf3564-0012-44da-98ad-324227667867 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:00.953012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf3564-0012-44da-98ad-324227667867 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:00.953280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf3564-0012-44da-98ad-324227667867 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:00.956499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:00.961711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf3564-0012-44da-98ad-324227667867 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:00.963131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf3564-0012-44da-98ad-324227667867 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-12cf3564-0012-44da-98ad-324227667867 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:51:00.975008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:00.976321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:00.977587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:00.981032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 606/1239] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:00 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:00.982658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:01.092479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b593b885-4f65-45c4-b17d-0dea9cffa17b None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:01.129211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:01.129861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.130177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.130468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.131362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:01.131667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:01.133114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:01.154047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 634/1240] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Aug 25 02:51:00 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:01.160182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf3564-0012-44da-98ad-324227667867 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:01.269294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf3564-0012-44da-98ad-324227667867 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:01.305048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:01.305709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.306062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.306340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.380460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:01.388990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:01.390724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:01.498931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 607/1241] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:51:01 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:51:01.504937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:01.534753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:01.617322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b644f2-0522-4f9d-af67-f126051cebe5 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:01.660354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:01.661004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.661317 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.661603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.673901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:01.676525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:01.694104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:01.695389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:01.696632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:01.696632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:01.696632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:01.696632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 635/1242] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:01.702072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:01.813171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:01.819653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600e01b4-75bd-40d0-93c6-132cda34198a None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:01.857226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:01.857940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:01.858225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:01.858500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:01.859184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:01.859498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:01.861154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:01.879654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 608/1243] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:01.880896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:01.977117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:02.003800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0706b7d4-7c49-434d-b898-d6570ef22370 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:02.040804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:02.041429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:02.041707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:02.041977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:02.049205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:02.050776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:51:02.063716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:02.064958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:02.066024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 636/1244] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:51:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 25 02:51:02.072224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:02.180800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df296e-e9b0-44ba-ab36-6908822845b4 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:02.218248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:02.219024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:02.219369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:02.219680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:02.220502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:02.220896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:02.222589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5751c59-8220-4618-b3b4-a5ed59e9792f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:02.237736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 609/1245] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:51:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:51:02.243856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:02.352460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa773418-45a6-416e-a9b8-b08a66851c2d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:02.394928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82341871-067b-4d34-a008-9babc01990be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:02.395602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82341871-067b-4d34-a008-9babc01990be None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:02.395881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82341871-067b-4d34-a008-9babc01990be None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:02.396183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82341871-067b-4d34-a008-9babc01990be None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:02.396922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82341871-067b-4d34-a008-9babc01990be None admin] RBAC: Adding query filter params (role.id=9d127b3c860443b7850907f65964f68b, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:02.397231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82341871-067b-4d34-a008-9babc01990be None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:02.398661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82341871-067b-4d34-a008-9babc01990be None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:02.406431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 637/1246] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:51:02 2022] GET /identity/v3/role_assignments?user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=9d127b3c860443b7850907f65964f68b => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:04.461754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee2e9-839f-4055-b7ae-b435fc0a4eea None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:04.462427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee2e9-839f-4055-b7ae-b435fc0a4eea None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:04.462427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10ee2e9-839f-4055-b7ae-b435fc0a4eea None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:04.463841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 610/1247] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:04.470520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:04.470971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:04.471202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:04.477754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:04.492031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:04.493453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:04.570227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 638/1248] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:04.863976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee2e9-839f-4055-b7ae-b435fc0a4eea None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:04.883437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:04.985512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10ee2e9-839f-4055-b7ae-b435fc0a4eea None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:05.022473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:05.023104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:05.023380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:05.023648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:05.034718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:51:05.039425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:05.040689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:05.041532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 611/1249] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:51:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:05.047427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:05.153353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f650c83d-acc0-4091-97f1-868a3465ddb5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:05.183350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:05.188562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:05.189166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:05.189452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:05.189712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:05.190371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:05.190669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:05.192052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:05.201014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 639/1250] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:51:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:51:05.206735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:05.299910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:05.326999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93982d7e-d22f-45a6-95bf-aa8444ee2539 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:05.366638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:05.367296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:05.367574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:05.367873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:05.380139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:05.381934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:05.398164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:05.399421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:05.400573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:05.400573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:05.400573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:05.400573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 612/1251] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:05.405613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:05.518567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7236d-069e-4d94-bf9b-fa2f38b51352 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:05.555574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:05.556292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:05.556575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:05.556909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:05.557579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:05.557991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:05.560155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:05.574255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 640/1252] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 02:51:05.580929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:05.690801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3858fcd0-dae8-4c5e-a483-05b312cd115d None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:05.717822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:05.726461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:05.727200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:05.727580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:05.727900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:05.736479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:05.737942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:51:05.750288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:05.751281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:05.752243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 613/1253] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:05 2022] GET /identity/v3/users/placement => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:05.757489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:05.820708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:05.869344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee04938-40cb-416e-9eed-1f7fddeec82d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:05.905815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:05.906486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:05.906768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:05.907041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:05.907908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:05.908258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:05.909795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:05.928603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 641/1254] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Aug 25 02:51:05 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:05.935349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:06.048118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8388f926-67d2-45c6-8b3e-a22f89ea613b None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:06.084697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:06.085290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.085568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.085839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.150959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:06.164450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:06.165921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:06.271301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 614/1255] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:51:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:51:06.278279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:06.392164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afaf20b9-77ac-42a2-b772-703bb4733186 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:06.407736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:06.432970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:06.433613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.434479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.434934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.445818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:06.447265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:06.462886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:06.464081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:06.465291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:06.465291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:06.465291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:06.465291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 642/1256] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:06.470615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:06.570815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:06.585858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96c21be-05b8-418c-ac59-921b3a580371 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:06.625427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:06.626286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.626574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.626849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.627589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:06.627989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:06.629839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:06.644365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 615/1257] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:06.650123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:06.762418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3788ad-dc4a-41bf-a9e4-7a6a5ed02d6f None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:06.799733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:06.800420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.800703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.800977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.808646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:06.810676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:51:06.822776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:06.823838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:06.825490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 643/1258] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:51:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:06.830725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:06.937534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08958196-c689-4c9f-ab65-aa838350eb56 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:06.973956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:06.974574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:06.974854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:06.975128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:06.975830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:06.976171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:06.977618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0569a711-dfa0-4093-bbe4-09f9b3c70624 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:06.990904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 616/1259] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:51:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:06.998367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:07.026213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:07.106914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87648d6-5c14-4562-8ea3-938c596385fb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:07.141312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:07.141918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:07.142200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:07.142474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:07.143206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:07.143515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:07.144981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a63275-5e57-4a0e-842e-c9e60a9b38ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:07.150671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 644/1260] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:51:06 2022] GET /identity/v3/role_assignments?user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:09.035839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113463-a224-4af1-9e11-47f654ac04a1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.036401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113463-a224-4af1-9e11-47f654ac04a1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.036499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3113463-a224-4af1-9e11-47f654ac04a1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.037766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 617/1261] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:09.042814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.043229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.043391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.062281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:09.063456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:09.129701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 645/1262] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:09.400796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113463-a224-4af1-9e11-47f654ac04a1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:09.411623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:09.499694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3113463-a224-4af1-9e11-47f654ac04a1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:09.532031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:09.532667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.532947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.533220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.542914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:51:09.548162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:09.549159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:09.550316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 618/1263] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:51:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:09.555108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:09.573565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:09.652028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197f4667-dbc7-434c-93b0-a45de621a250 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:09.685712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:09.686304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.686593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.686888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.687553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:09.687853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:09.689238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:09.696956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 646/1264] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:51:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:09.702746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:09.767780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:09.800726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa49c7-7c1e-4104-b78c-8c7aacc11c11 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:09.832676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:09.833280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.833554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.833819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.843790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:09.845230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:09.859757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:09.860856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:09.861868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:09.861868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:09.861868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:09.861868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 619/1265] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:09.866606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:09.945919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:09.964826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa16292d-8056-4a9a-b20b-62eed05353d2 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:09.997768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:09.998360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:09.998635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:09.998902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:09.999534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:09.999831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.001208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.012666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 647/1266] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:10.018328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.115331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ade590-c601-49e9-a03f-0102432edf89 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.133797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:10.157721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.158350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.158630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.158899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.166551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.167972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:51:10.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:10.179860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:10.181249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 620/1267] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/users/placement => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:10.186098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.290983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffb7176-303b-43e0-839e-822c0bf6083e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.323321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.323917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.324225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.325105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.325834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:10.326136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.327549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.335912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:10.346572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 648/1268] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:10.352435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.461092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d72df04-4a69-4e2c-b6a9-b100798ff2e3 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.493490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.494105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.494383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.494655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.505311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.506744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:10.521254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:10.522434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:10.523414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:10.523414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:10.523414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:10.523414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 621/1269] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:10.528295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.624011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d7b849-f15f-4d98-a512-baa4747001fb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.657073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.657672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.657951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.658221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.658856 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:10.659155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.660545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.671341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 649/1270] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:10.677062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.709296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:10.776350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe29b20-4451-4246-abce-4e8e4ec36188 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.809284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.809906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.810187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.810458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.816849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.818262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:51:10.829628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:10.830682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:10.831778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 622/1271] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:10.836583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:10.894429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:10.936164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e24ccc-877f-48d8-a694-9337bbe38dcb None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:10.968822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:10.969413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:10.969689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:10.969957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:10.970643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:10.970947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:10.972400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39539169-fe0a-4e1d-a09d-cd8cb500f2d8 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:10.984369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 650/1272] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:51:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:10.990498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:11.080346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:11.088720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fb0af-b1c1-41a8-89d5-800c537c409f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:11.122852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25bad24-1445-40d7-be0b-a042c4b01113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:11.123491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bad24-1445-40d7-be0b-a042c4b01113 None admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:11.123768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bad24-1445-40d7-be0b-a042c4b01113 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:11.124064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25bad24-1445-40d7-be0b-a042c4b01113 None admin] PATH_INFO: `/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/526b8be76d1c4c1fbcc1c3ae97c5ead4/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:11.125923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bad24-1445-40d7-be0b-a042c4b01113 None admin] RBAC: Authorizing `identity:create_grant(project_id=95ee65feb1754bef9a8c68f8c91bea7d, user_id=526b8be76d1c4c1fbcc1c3ae97c5ead4, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:11.127330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e25bad24-1445-40d7-be0b-a042c4b01113 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:11.139777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 623/1273] 10.222.0.72 () {58 vars in 1439 bytes} [Thu Aug 25 02:51:10 2022] PUT /identity/v3/projects/95ee65feb1754bef9a8c68f8c91bea7d/users/526b8be76d1c4c1fbcc1c3ae97c5ead4/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:51:13.012511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2e3d-640a-49eb-8c6f-256febc9a800 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.013031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2e3d-640a-49eb-8c6f-256febc9a800 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.013146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343f2e3d-640a-49eb-8c6f-256febc9a800 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.014514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 651/1274] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:13.019696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.020128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.020273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.038249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:13.039412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:13.103231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 624/1275] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:13 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:13.370107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2e3d-640a-49eb-8c6f-256febc9a800 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:13.474410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343f2e3d-640a-49eb-8c6f-256febc9a800 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:13.491509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:13.507864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:13.508507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.508786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.509057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.519086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 25 02:51:13.523704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:13.524810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:13.525762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 652/1276] 10.222.0.72 () {56 vars in 1096 bytes} [Thu Aug 25 02:51:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:13.531223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:13.608388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:13.626463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bbfa4b8-319b-404d-a2ea-b9dbb80fafcb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:13.658954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:13.659532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.659804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.660093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.660741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:13.661035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:13.662368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:13.670089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 625/1277] 10.222.0.72 () {56 vars in 1099 bytes} [Thu Aug 25 02:51:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:13.675707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:13.774121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4028f202-0252-443d-b197-2f1c72b7ef9e None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:13.807941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:13.808643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.808926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.809200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.819347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:13.820796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:13.835386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:13.836564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:13.837789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:13.837789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:13.837789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:13.837789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 653/1278] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:13.842942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:13.937934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee36ab71-486b-4d79-bd3f-2d6f4d42da64 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:13.971037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:13.971626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:13.971901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:13.972203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:13.972832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:13.973127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:13.974466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:13.986213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 626/1279] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:13.991843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:14.022865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:14.091945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9683e936-8626-4409-bcdc-806d50573a29 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:14.125028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:14.125650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:14.125931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:14.126209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] PATH_INFO: `/v3/users/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:14.133406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:14.134828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 25 02:51:14.146277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:14.147387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:14.148393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 654/1280] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:14.153166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:14.156945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:14.254038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d48b61-30e6-4744-b165-c535e0040709 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:14.287549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:14.288177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:14.288466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:14.288740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:14.289458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:14.289766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:14.291178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:14.308019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 627/1281] 10.222.0.72 () {56 vars in 1143 bytes} [Thu Aug 25 02:51:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:14.313923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:14.406289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:14.416127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57eb4d63-9ed7-4ee8-b1cb-2cbdd7d5f6ab None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:14.449009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:14.449606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:14.449897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:14.450149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:14.514954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:14.516335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:14.601159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:14.611884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 655/1282] 10.222.0.72 () {58 vars in 1282 bytes} [Thu Aug 25 02:51:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 25 02:51:14.617637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:14.677517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:14.714896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52f23d-a15b-4104-8a13-5f19ca71f4ed None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:14.747956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:14.748590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:14.748874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:14.749145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:14.758794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:14.760261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 25 02:51:14.774713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:14.775788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 25 02:51:14.777151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 25 02:51:14.777151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 25 02:51:14.777151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:14.777151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 628/1283] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:51:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:14.781513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:14.877861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b74803-ec4c-4a73-b0a8-a43f5def88dc None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:14.910337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:14.910929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:14.911206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:14.911475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:14.912136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:14.912441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:14.913788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:14.924994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 656/1284] 10.222.0.72 () {56 vars in 1109 bytes} [Thu Aug 25 02:51:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:14.930514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:15.029014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d7d3df-823d-4d31-b820-408f5c1f0b1e None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:15.041871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:15.061934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:15.062544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:15.062822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:15.063092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:15.069479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:15.070914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 25 02:51:15.081736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:15.082735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: ERROR keystone.server.flask.application Aug 25 02:51:15.088378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 629/1285] 10.222.0.72 () {56 vars in 1111 bytes} [Thu Aug 25 02:51:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:15.089004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:15.138716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:15.188118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8949df5b-ce28-4c78-bf46-961a98c02576 None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:15.220231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:15.220815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:15.221090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:15.221358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:15.222035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:15.222334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:15.223736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72fa031-8dde-4685-9ff3-f876af12a9a9 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:15.235672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 657/1286] 10.222.0.72 () {56 vars in 1148 bytes} [Thu Aug 25 02:51:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:15.241652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:15.339383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bef041-d7d9-4e4f-b4a7-861ae40ce1c9 None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:15.375473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:15.376093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:15.376374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:15.376649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:15.377366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] RBAC: Adding query filter params (role.id=1805185e98c2434aa68c10e77ddb16ee, scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d, user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:15.377674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:15.379084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f193c07-1985-4ef3-83b1-8506ed003045 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:15.384769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 630/1287] 10.222.0.72 () {56 vars in 1374 bytes} [Thu Aug 25 02:51:15 2022] GET /identity/v3/role_assignments?user.id=526b8be76d1c4c1fbcc1c3ae97c5ead4&scope.project.id=95ee65feb1754bef9a8c68f8c91bea7d&role.id=1805185e98c2434aa68c10e77ddb16ee => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:17.387952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd45b-7615-4a52-9522-0de762e182e5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:17.388507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd45b-7615-4a52-9522-0de762e182e5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:17.388507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fbd45b-7615-4a52-9522-0de762e182e5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:17.389943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 658/1288] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:17.395772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:17.396207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:17.396347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:17.414416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:17.415609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:17.448126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:17.486013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 631/1289] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:17.755499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd45b-7615-4a52-9522-0de762e182e5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:17.854961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fbd45b-7615-4a52-9522-0de762e182e5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:17.865930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:17.889374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:17.889991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:17.890269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:17.890538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] PATH_INFO: `/v3/services/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:17.891112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:17.892501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:17.900875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:17.902053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:17.903017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 659/1290] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:51:17 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:17.908029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:18.004163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab1b7ea-0724-429c-8ec9-7bdea07cd5bf None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:18.036580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:18.037109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:18.037385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:18.037652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:18.038273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] RBAC: Adding query filter params (name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:18.038569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:18.039924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95804fe-75ad-4e32-bedf-6e79d75e487d None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:18.045153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 632/1291] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Aug 25 02:51:17 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:18.050909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:18.148881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5998f2-e8fd-41be-a468-0a429a7fd16c None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:18.182135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:18.182725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:18.183002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:18.183270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] PATH_INFO: `/v3/services` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:18.183891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:18.184242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:18.185991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f59e419e-e5f8-4d83-b222-cf755509ddc0 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:18.190762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 660/1292] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Aug 25 02:51:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:20.073007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c5f0-7504-4a1d-b956-83bcdaa9d320 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:20.073571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c5f0-7504-4a1d-b956-83bcdaa9d320 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:20.073571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2351c5f0-7504-4a1d-b956-83bcdaa9d320 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:20.075459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 633/1293] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:20.080708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1536-6068-4d45-a90f-5089c65bf531 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:20.081100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1536-6068-4d45-a90f-5089c65bf531 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:20.081255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed2f1536-6068-4d45-a90f-5089c65bf531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:20.099600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ed2f1536-6068-4d45-a90f-5089c65bf531 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:20.100817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ed2f1536-6068-4d45-a90f-5089c65bf531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:20.129561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:20.172739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 661/1294] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:20.463314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351c5f0-7504-4a1d-b956-83bcdaa9d320 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:20.493754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:20.562699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2351c5f0-7504-4a1d-b956-83bcdaa9d320 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:20.594587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f34aebe-0db0-47d7-b1d4-0cb1290c06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:20.595181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34aebe-0db0-47d7-b1d4-0cb1290c06e6 None admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:20.595456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34aebe-0db0-47d7-b1d4-0cb1290c06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:20.595724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f34aebe-0db0-47d7-b1d4-0cb1290c06e6 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:20.596394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34aebe-0db0-47d7-b1d4-0cb1290c06e6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:20.597744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f34aebe-0db0-47d7-b1d4-0cb1290c06e6 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:20.612331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 634/1295] 10.222.0.72 () {60 vars in 1141 bytes} [Thu Aug 25 02:51:20 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:51:22.509567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eec2-f9d9-4cbc-b7c4-706733629901 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:22.510097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eec2-f9d9-4cbc-b7c4-706733629901 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:22.510097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e09eec2-f9d9-4cbc-b7c4-706733629901 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:22.511712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 662/1296] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:22.517505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:22.517891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:22.518049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:22.535886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:22.537103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:22.607696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 635/1297] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:22 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:22.875634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eec2-f9d9-4cbc-b7c4-706733629901 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:22.976615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e09eec2-f9d9-4cbc-b7c4-706733629901 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:23.009709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:23.010322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:23.010853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:23.011124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:23.011700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:23.013362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:23.021752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:23.022912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:23.023973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 663/1298] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:51:22 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:23.028872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:23.047208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:23.126721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e0e87d-2d61-483a-a958-d8974e0f4ac0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:23.160436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:23.161037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:23.161318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:23.161590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:23.162218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:23.162518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:23.163870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:23.168954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 636/1299] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Aug 25 02:51:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:23.174881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:23.206346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:23.273729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb7febe-b496-454b-bbb9-e358bf71225d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:23.305975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:23.306565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:23.306843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:23.307112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:23.307805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] RBAC: Adding query filter params (interface=public, service_id=90408d1d87554b64b380482be038429b, region_id=RegionOne) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:23.308135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:23.310013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef5e1e5-0f1b-4c86-87fd-9de3375d7f87 None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:23.314891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 664/1300] 10.222.0.72 () {56 vars in 1251 bytes} [Thu Aug 25 02:51:23 2022] GET /identity/v3/endpoints?service_id=90408d1d87554b64b380482be038429b&interface=public®ion_id=RegionOne => generated 194 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:23.320680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:23.415526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:23.433319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9667b094-b391-4102-8f04-dede40a4a82f None admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:23.466641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e0623d-89d4-4ede-9a99-7741cd5acb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:23.467234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0623d-89d4-4ede-9a99-7741cd5acb03 None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:23.467508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0623d-89d4-4ede-9a99-7741cd5acb03 None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:23.467778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e0623d-89d4-4ede-9a99-7741cd5acb03 None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:23.468399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0623d-89d4-4ede-9a99-7741cd5acb03 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:23.469741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e0623d-89d4-4ede-9a99-7741cd5acb03 None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:23.476366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 637/1301] 10.222.0.72 () {56 vars in 1087 bytes} [Thu Aug 25 02:51:23 2022] GET /identity/v3/services => generated 2191 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:51:25.358101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb03a9-faad-4a08-93ac-5b274ead55aa None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:25.358627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb03a9-faad-4a08-93ac-5b274ead55aa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:25.358627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eb03a9-faad-4a08-93ac-5b274ead55aa None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:25.359994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 665/1302] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:51:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:51:25.365083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:25.365453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:25.365632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:25.383319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:51:25.384528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:51:25.451090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 638/1303] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:51:25 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 25 02:51:25.719480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb03a9-faad-4a08-93ac-5b274ead55aa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:25.813012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:25.820167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eb03a9-faad-4a08-93ac-5b274ead55aa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:25.853715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:25.854328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:25.854606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:25.854874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:25.855448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:25.856865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 25 02:51:25.865262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 25 02:51:25.866380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.get_or_create( Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application with Lock( Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self._enter() Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application return self.creator() Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application created_value = creator( Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: ERROR keystone.server.flask.application Aug 25 02:51:25.867237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 666/1304] 10.222.0.72 () {56 vars in 1117 bytes} [Thu Aug 25 02:51:25 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 25 02:51:25.872379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:25.947174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:25.971894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982de435-8c26-4fad-bdb4-420c49a4df96 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:26.004208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:26.004813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:26.005094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:26.005368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] PATH_INFO: `/v3/services` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:26.005995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] RBAC: Adding query filter params (name=placement) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:51:26.006299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:26.007662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e278139-998f-4939-9934-0833c4abc8cc None admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:26.013690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 639/1305] 10.222.0.72 () {56 vars in 1116 bytes} [Thu Aug 25 02:51:25 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:51:26.019587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:51:26.118128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4221a04f-619d-45a4-aea4-7d0ddd1e110d None admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:51:26.150840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e48876-7b55-4b12-b5b3-7ab64b42cd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:51:26.151427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e48876-7b55-4b12-b5b3-7ab64b42cd7d None admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:51:26.151704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e48876-7b55-4b12-b5b3-7ab64b42cd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:51:26.151975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e48876-7b55-4b12-b5b3-7ab64b42cd7d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:51:26.152727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e48876-7b55-4b12-b5b3-7ab64b42cd7d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:51:26.154415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e48876-7b55-4b12-b5b3-7ab64b42cd7d None admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:51:26.173930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 667/1306] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:51:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:51:36.009725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=30 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:51:36.169773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:29.667451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a6b7-285a-42b5-a70e-81c4d78996f7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:29.668449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a6b7-285a-42b5-a70e-81c4d78996f7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:29.669273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5856a6b7-285a-42b5-a70e-81c4d78996f7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:29.676235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1685f-1094-4625-ae18-e1e55484dcf1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:29.677118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1685f-1094-4625-ae18-e1e55484dcf1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:29.677390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca1685f-1094-4625-ae18-e1e55484dcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:29.682500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 640/1307] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:29 2022] GET /identity => generated 270 bytes in 16 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:29.756863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2ca1685f-1094-4625-ae18-e1e55484dcf1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:29.758153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2ca1685f-1094-4625-ae18-e1e55484dcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:29.868274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 668/1308] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:52:30.175020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4d0f-a4c3-4225-8a75-751ed4623cfb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:30.175617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4d0f-a4c3-4225-8a75-751ed4623cfb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:30.176114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efb4d0f-a4c3-4225-8a75-751ed4623cfb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:30.177970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 641/1309] 10.222.0.72 () {54 vars in 965 bytes} [Thu Aug 25 02:52:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:30.185030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d05994-f3be-4106-881c-7bc1f7a72797 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:30.185316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d05994-f3be-4106-881c-7bc1f7a72797 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:30.185579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d05994-f3be-4106-881c-7bc1f7a72797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:30.293010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-74d05994-f3be-4106-881c-7bc1f7a72797 None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:30.294325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-74d05994-f3be-4106-881c-7bc1f7a72797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:30.315825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:30.377480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 669/1310] 10.222.0.72 () {58 vars in 1062 bytes} [Thu Aug 25 02:52:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:30.388496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb4d0f-a4c3-4225-8a75-751ed4623cfb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:30.390304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6efb4d0f-a4c3-4225-8a75-751ed4623cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:30.517652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efb4d0f-a4c3-4225-8a75-751ed4623cfb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:30.604894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:30.605789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:30.606082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:30.606341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:30.608072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:30.668552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:30.725882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:30.727310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a592943-bc2b-4035-b57a-ab70de33b64b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:30.747642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 642/1311] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:32.954707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87136c5-98cd-4620-b419-8abc9815e184 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:32.955429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87136c5-98cd-4620-b419-8abc9815e184 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:32.955429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87136c5-98cd-4620-b419-8abc9815e184 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:32.956931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 670/1312] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:52:32.962904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ab4a-898f-4ccc-8b8d-11d252653006 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:32.963465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ab4a-898f-4ccc-8b8d-11d252653006 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:32.963556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6314ab4a-898f-4ccc-8b8d-11d252653006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:33.049279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6314ab4a-898f-4ccc-8b8d-11d252653006 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:33.050489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6314ab4a-898f-4ccc-8b8d-11d252653006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:33.150676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 643/1313] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:33.448368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e864f-dd4d-48f0-aa5c-2a82048ed907 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:33.448656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e864f-dd4d-48f0-aa5c-2a82048ed907 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:33.448928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495e864f-dd4d-48f0-aa5c-2a82048ed907 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:33.450265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 671/1314] 10.222.0.72 () {54 vars in 965 bytes} [Thu Aug 25 02:52:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:33.456121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510049b-7a8d-4b37-aab2-523d102d09c6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:33.456410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510049b-7a8d-4b37-aab2-523d102d09c6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:33.456688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e510049b-7a8d-4b37-aab2-523d102d09c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:33.469000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:33.531717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e510049b-7a8d-4b37-aab2-523d102d09c6 None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:33.532859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e510049b-7a8d-4b37-aab2-523d102d09c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:33.606465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 644/1315] 10.222.0.72 () {58 vars in 1062 bytes} [Thu Aug 25 02:52:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:33.615411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e864f-dd4d-48f0-aa5c-2a82048ed907 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:33.617026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-495e864f-dd4d-48f0-aa5c-2a82048ed907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:33.721468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495e864f-dd4d-48f0-aa5c-2a82048ed907 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:33.795346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:33.798128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:33.798933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:33.799259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:33.799695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:33.801529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:33.909476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:33.910905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eb511e-ac8b-439e-84f8-e7e25dd964c3 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:33.928965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 672/1316] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:52:36.382813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c81a-3817-4e85-bcce-a6edbb46c8e9 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:36.383293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c81a-3817-4e85-bcce-a6edbb46c8e9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:36.384158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde7c81a-3817-4e85-bcce-a6edbb46c8e9 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:36.385510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 645/1317] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:36.390658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca396e-3568-4694-a19e-4b8d9df61f98 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:36.391066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca396e-3568-4694-a19e-4b8d9df61f98 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:36.391210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ca396e-3568-4694-a19e-4b8d9df61f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:36.456915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a2ca396e-3568-4694-a19e-4b8d9df61f98 None None] MFA Rules not processed for user `424c0059899e44a9a6a3b85a4aeaedea`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:36.458122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a2ca396e-3568-4694-a19e-4b8d9df61f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:36.509486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:36.553500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 673/1318] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:36 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:36.845751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c81a-3817-4e85-bcce-a6edbb46c8e9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:36.847338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cde7c81a-3817-4e85-bcce-a6edbb46c8e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:36.951740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde7c81a-3817-4e85-bcce-a6edbb46c8e9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:36.954569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:37.025037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:37.025633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:37.025909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:37.026178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:37.027761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:37.132762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:37.134551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c693e1-f64c-41e8-8885-7916010c09ef service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:37.160859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 646/1319] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:36 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:39.614479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c39ef4-bb7e-4c4c-a85c-2c739c4b1b16 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:39.614999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c39ef4-bb7e-4c4c-a85c-2c739c4b1b16 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:39.615095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c39ef4-bb7e-4c4c-a85c-2c739c4b1b16 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:39.616417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 674/1320] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:39.621847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e9592-d392-42df-893b-324f1aa35c9a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:39.622258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e9592-d392-42df-893b-324f1aa35c9a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:39.622393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78e9592-d392-42df-893b-324f1aa35c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:39.664256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:39.689572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a78e9592-d392-42df-893b-324f1aa35c9a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:39.690772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a78e9592-d392-42df-893b-324f1aa35c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:39.785537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 647/1321] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:40.069517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c39ef4-bb7e-4c4c-a85c-2c739c4b1b16 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:40.071055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a7c39ef4-bb7e-4c4c-a85c-2c739c4b1b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:40.173897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c39ef4-bb7e-4c4c-a85c-2c739c4b1b16 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:40.244743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:40.245271 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:40.245546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:40.245810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:40.247391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:40.255521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:40.361741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:40.363484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35052d7e-a1da-444f-ab66-be9070acb8a9 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:40.382191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 675/1322] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:40 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:42.944846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc0f-0d59-44d1-b9ae-9c3cf1ef1969 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:42.945352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc0f-0d59-44d1-b9ae-9c3cf1ef1969 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:42.945453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc84bc0f-0d59-44d1-b9ae-9c3cf1ef1969 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:42.947047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 648/1323] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:42.952345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fed16-44d8-4679-bf2b-996a793f145d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:42.952827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fed16-44d8-4679-bf2b-996a793f145d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:42.952934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3fed16-44d8-4679-bf2b-996a793f145d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:43.018099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0d3fed16-44d8-4679-bf2b-996a793f145d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:43.019290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0d3fed16-44d8-4679-bf2b-996a793f145d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:43.078803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:43.119201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 676/1324] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:43.407639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84bc0f-0d59-44d1-b9ae-9c3cf1ef1969 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:43.409252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fc84bc0f-0d59-44d1-b9ae-9c3cf1ef1969 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:43.517950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc84bc0f-0d59-44d1-b9ae-9c3cf1ef1969 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:43.530905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:43.594203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:43.594806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:43.595083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:43.595355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:43.596998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:43.707677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:43.709149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47ea425f-2b7f-4fcc-93f2-3a68e73d3e94 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:43.730557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 649/1325] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:45.718542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0617dc-824e-40ec-8a56-2a9b783cc1f2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.719069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0617dc-824e-40ec-8a56-2a9b783cc1f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.719069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0617dc-824e-40ec-8a56-2a9b783cc1f2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.720389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 677/1326] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:45.725623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3cb9-3e6b-46b7-a481-40c1e6810f19 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:45.726038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3cb9-3e6b-46b7-a481-40c1e6810f19 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:45.726162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f3cb9-3e6b-46b7-a481-40c1e6810f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:45.773732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:45.793023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ca5f3cb9-3e6b-46b7-a481-40c1e6810f19 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:45.794212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca5f3cb9-3e6b-46b7-a481-40c1e6810f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:45.889044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 650/1327] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:46.169487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0617dc-824e-40ec-8a56-2a9b783cc1f2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:46.171011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-db0617dc-824e-40ec-8a56-2a9b783cc1f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.279288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0617dc-824e-40ec-8a56-2a9b783cc1f2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:46.354141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:46.354747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:46.355028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:46.355301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:46.356949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:46.373947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:46.468361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:46.470069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113b3919-8153-43c3-b532-2008d452e404 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:46.487812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 678/1328] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:48.491493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9bc9-2668-480e-b894-0c91716dba28 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:48.492099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9bc9-2668-480e-b894-0c91716dba28 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:48.492099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fe9bc9-2668-480e-b894-0c91716dba28 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:48.493782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 651/1329] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:48.499006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741b82-96af-4f6f-80e2-48053a7ee745 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:48.499470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741b82-96af-4f6f-80e2-48053a7ee745 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:48.499564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20741b82-96af-4f6f-80e2-48053a7ee745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:48.564499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-20741b82-96af-4f6f-80e2-48053a7ee745 None None] MFA Rules not processed for user `424c0059899e44a9a6a3b85a4aeaedea`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:48.565688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-20741b82-96af-4f6f-80e2-48053a7ee745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:48.630204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:48.665734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 679/1330] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:48 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:48.951650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9bc9-2668-480e-b894-0c91716dba28 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:48.953272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3fe9bc9-2668-480e-b894-0c91716dba28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:49.058659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fe9bc9-2668-480e-b894-0c91716dba28 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:49.078009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:49.132725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:49.133271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:49.133811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:49.134138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:49.136111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:49.254733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:49.256220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b25398-4412-4fa2-a623-2d3e40b5675d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:49.284788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 652/1331] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:48 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:51.446357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8b32d-2a78-4772-a627-f2b6188c3e13 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:51.446905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8b32d-2a78-4772-a627-f2b6188c3e13 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:51.446905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a8b32d-2a78-4772-a627-f2b6188c3e13 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:51.448322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 680/1332] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:51.453514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cf869-d304-4aa3-8d7b-4f59ce3c96ce None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:51.453957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cf869-d304-4aa3-8d7b-4f59ce3c96ce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:51.454079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11cf869-d304-4aa3-8d7b-4f59ce3c96ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:51.517452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:51.520476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f11cf869-d304-4aa3-8d7b-4f59ce3c96ce None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:51.522124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f11cf869-d304-4aa3-8d7b-4f59ce3c96ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:51.617703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 653/1333] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:51.906173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8b32d-2a78-4772-a627-f2b6188c3e13 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:51.907714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-68a8b32d-2a78-4772-a627-f2b6188c3e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:52.011044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a8b32d-2a78-4772-a627-f2b6188c3e13 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:52.082101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:52.082696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:52.082971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:52.083239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:52.084859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:52.111066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:52.191394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:52.192824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24317bc-2f59-4333-ba47-3641fd0c104a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:52.210950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 681/1334] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:54.172487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20965ad1-9221-4338-aa69-cc7193870dce None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:54.173050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20965ad1-9221-4338-aa69-cc7193870dce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:54.173050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20965ad1-9221-4338-aa69-cc7193870dce None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:54.174394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 654/1335] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:54.179448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f4a1-ccde-4a3d-89f6-f33119d7f097 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:54.179817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f4a1-ccde-4a3d-89f6-f33119d7f097 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:54.180002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a9f4a1-ccde-4a3d-89f6-f33119d7f097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:54.245943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-51a9f4a1-ccde-4a3d-89f6-f33119d7f097 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:54.247096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-51a9f4a1-ccde-4a3d-89f6-f33119d7f097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:54.322804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:54.345526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 682/1336] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:54.631102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20965ad1-9221-4338-aa69-cc7193870dce None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:54.632697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20965ad1-9221-4338-aa69-cc7193870dce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:54.737025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20965ad1-9221-4338-aa69-cc7193870dce None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:54.765769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:54.810161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:54.810761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:54.811039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:54.811330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:54.812968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:54.921817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:54.923187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31792ad2-95d4-4ce6-8ff1-3ebd86f4a5d2 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:54.941065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 655/1337] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:52:57.173512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badb4f3-f15e-42a6-9fa1-0cf4119ed2f0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:57.174059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badb4f3-f15e-42a6-9fa1-0cf4119ed2f0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:57.174059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9badb4f3-f15e-42a6-9fa1-0cf4119ed2f0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:57.175412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 683/1338] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:52:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:52:57.180731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df195175-069b-4e6c-b71c-90a3e750501f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:57.181411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df195175-069b-4e6c-b71c-90a3e750501f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:57.181630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df195175-069b-4e6c-b71c-90a3e750501f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:57.246872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-df195175-069b-4e6c-b71c-90a3e750501f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:52:57.247977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df195175-069b-4e6c-b71c-90a3e750501f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:57.256217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:57.343971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 656/1339] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:52:57 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:52:57.631911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badb4f3-f15e-42a6-9fa1-0cf4119ed2f0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:52:57.633480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9badb4f3-f15e-42a6-9fa1-0cf4119ed2f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:57.736774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9badb4f3-f15e-42a6-9fa1-0cf4119ed2f0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:52:57.808497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:52:57.809098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:52:57.809376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:52:57.809645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:52:57.811239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:52:57.846730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:52:57.918866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:52:57.920263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703efafb-9125-430c-a0a3-946ca73978a7 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:52:57.938486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 684/1340] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:52:57 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:01.809208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b152b-eb17-4ea2-be47-cd0662fc4076 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:01.809781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b152b-eb17-4ea2-be47-cd0662fc4076 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:01.809781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33b152b-eb17-4ea2-be47-cd0662fc4076 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:01.811104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 657/1341] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:01.816460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177829aa-19d1-4b04-bf62-64e7e63e1bdc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:01.816893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177829aa-19d1-4b04-bf62-64e7e63e1bdc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:01.817152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177829aa-19d1-4b04-bf62-64e7e63e1bdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:01.887072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-177829aa-19d1-4b04-bf62-64e7e63e1bdc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:01.888312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-177829aa-19d1-4b04-bf62-64e7e63e1bdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:01.981126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:01.992653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 685/1342] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:02.293671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b152b-eb17-4ea2-be47-cd0662fc4076 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:02.295200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f33b152b-eb17-4ea2-be47-cd0662fc4076 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:02.406356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33b152b-eb17-4ea2-be47-cd0662fc4076 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:02.446131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:02.485598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:02.486211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:02.486488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:02.486758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:02.488390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:02.601616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:02.603449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-526d40e1-63a2-4dfe-8b09-82077a94a927 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:02.623176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 658/1343] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:05.265833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e225b6e-22d6-4714-b54d-db7005aab9e0 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:05.266225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e225b6e-22d6-4714-b54d-db7005aab9e0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:05.266421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e225b6e-22d6-4714-b54d-db7005aab9e0 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:05.267906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 686/1344] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:05.273409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245ad57-d59a-49a9-bffa-86e7423bd33c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:05.273843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245ad57-d59a-49a9-bffa-86e7423bd33c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:05.273961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c245ad57-d59a-49a9-bffa-86e7423bd33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:05.339701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c245ad57-d59a-49a9-bffa-86e7423bd33c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:05.340926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c245ad57-d59a-49a9-bffa-86e7423bd33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:05.360786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:05.441904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 659/1345] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:05.735208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e225b6e-22d6-4714-b54d-db7005aab9e0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:05.736834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e225b6e-22d6-4714-b54d-db7005aab9e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:05.845955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e225b6e-22d6-4714-b54d-db7005aab9e0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:05.921397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:05.921997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:05.922272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:05.922538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:05.924598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:05.970928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:06.051819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:06.053321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3da3a3-0e94-4b3e-bcdf-1ed4e53d5439 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:06.073722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 687/1346] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:10.010414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00b34-a8e7-48c7-b21a-5131cd9f6124 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:10.010942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00b34-a8e7-48c7-b21a-5131cd9f6124 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:10.010942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f00b34-a8e7-48c7-b21a-5131cd9f6124 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:10.012379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 660/1347] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:10.017897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb8e35-2935-438b-b839-5b32d770b358 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:10.018348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb8e35-2935-438b-b839-5b32d770b358 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:10.018439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfb8e35-2935-438b-b839-5b32d770b358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:10.089039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ecfb8e35-2935-438b-b839-5b32d770b358 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:10.090260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ecfb8e35-2935-438b-b839-5b32d770b358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:10.189858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:10.194194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 688/1348] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:10.481493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00b34-a8e7-48c7-b21a-5131cd9f6124 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:10.483051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d2f00b34-a8e7-48c7-b21a-5131cd9f6124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:10.586077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f00b34-a8e7-48c7-b21a-5131cd9f6124 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:10.633592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:10.660601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:10.661202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:10.661480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:10.661753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:10.663361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:10.769744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:10.771092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dee95c8-e778-43b8-ac83-9b4efc0cb237 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:10.789616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 661/1349] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:15.720285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa4c2-b1d2-468e-8998-bcaf36a0dfec None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:15.720844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa4c2-b1d2-468e-8998-bcaf36a0dfec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:15.720844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020aa4c2-b1d2-468e-8998-bcaf36a0dfec None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:15.722522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 689/1350] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 02:53:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:15.736794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204080a2-f8f7-4fd2-ae62-6e59e6a61907 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:15.737248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204080a2-f8f7-4fd2-ae62-6e59e6a61907 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:15.737335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204080a2-f8f7-4fd2-ae62-6e59e6a61907 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:15.869214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-204080a2-f8f7-4fd2-ae62-6e59e6a61907 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:15.870405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-204080a2-f8f7-4fd2-ae62-6e59e6a61907 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:15.898057 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:15.995517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 662/1351] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 02:53:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 260 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:20.204015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0445b-7c00-4416-a2a9-9a35ad350c59 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:20.204615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0445b-7c00-4416-a2a9-9a35ad350c59 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:20.204615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b0445b-7c00-4416-a2a9-9a35ad350c59 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:20.206106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 690/1352] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 02:53:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:20.211266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051420b-2702-4856-adf8-5eca677de803 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:20.211666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051420b-2702-4856-adf8-5eca677de803 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:20.211875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9051420b-2702-4856-adf8-5eca677de803 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:20.296224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9051420b-2702-4856-adf8-5eca677de803 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:20.297433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9051420b-2702-4856-adf8-5eca677de803 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:20.371987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:20.411201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 663/1353] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 02:53:20 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:21.874951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420fab-9503-4e32-b8ba-7dade4fc13e6 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:21.875483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420fab-9503-4e32-b8ba-7dade4fc13e6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:21.875612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8420fab-9503-4e32-b8ba-7dade4fc13e6 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:21.876999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 691/1354] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 02:53:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:21.882093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db33d0b-d353-4354-8e97-05b908c5d762 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:21.882504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db33d0b-d353-4354-8e97-05b908c5d762 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:21.882639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db33d0b-d353-4354-8e97-05b908c5d762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:21.961327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6db33d0b-d353-4354-8e97-05b908c5d762 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:21.963405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6db33d0b-d353-4354-8e97-05b908c5d762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:22.072844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 664/1355] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 02:53:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:25.344163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505598b-24d9-43ff-be0e-a703c31b0a7b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:25.344723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505598b-24d9-43ff-be0e-a703c31b0a7b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:25.344723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b505598b-24d9-43ff-be0e-a703c31b0a7b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:25.346052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 692/1356] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:25.351394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eb91-60f0-4cb3-97b7-54c513f9cf98 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:25.351807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eb91-60f0-4cb3-97b7-54c513f9cf98 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:25.351945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a2eb91-60f0-4cb3-97b7-54c513f9cf98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:25.394635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:25.434926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e2a2eb91-60f0-4cb3-97b7-54c513f9cf98 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:25.436149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e2a2eb91-60f0-4cb3-97b7-54c513f9cf98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:25.570857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 665/1357] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:25.876775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5582-cf85-44fe-b449-57e6e4020922 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:25.877861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5582-cf85-44fe-b449-57e6e4020922 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:25.878308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6e5582-cf85-44fe-b449-57e6e4020922 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:25.880725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 693/1358] 10.222.0.72 () {54 vars in 962 bytes} [Thu Aug 25 02:53:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:25.890315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e77d31-ce5a-4dc7-99c0-6209d1619565 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:25.890941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e77d31-ce5a-4dc7-99c0-6209d1619565 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:25.891414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e77d31-ce5a-4dc7-99c0-6209d1619565 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:25.996927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e3e77d31-ce5a-4dc7-99c0-6209d1619565 None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:25.998157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e3e77d31-ce5a-4dc7-99c0-6209d1619565 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:26.059268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:26.133750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 666/1359] 10.222.0.72 () {58 vars in 1059 bytes} [Thu Aug 25 02:53:25 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:26.141831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5582-cf85-44fe-b449-57e6e4020922 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:26.143326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd6e5582-cf85-44fe-b449-57e6e4020922 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:26.300172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6e5582-cf85-44fe-b449-57e6e4020922 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:26.385304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:26.429673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:26.430430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:26.430850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:26.431342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:26.433033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:26.525993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:26.527671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7015561e-fbb4-4e6d-8d4e-341087398e66 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:26.546723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 694/1360] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:28.709714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9132-203b-446f-9d93-a0eeb27f024c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:28.710244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9132-203b-446f-9d93-a0eeb27f024c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:28.710488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974a9132-203b-446f-9d93-a0eeb27f024c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:28.711876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 667/1361] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:28.717837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755277-82b9-4c93-b530-19b48fb9581e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:28.718302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755277-82b9-4c93-b530-19b48fb9581e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:28.718426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e755277-82b9-4c93-b530-19b48fb9581e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:28.789913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7e755277-82b9-4c93-b530-19b48fb9581e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:28.791989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7e755277-82b9-4c93-b530-19b48fb9581e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:28.831838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:28.904206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 695/1362] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:53:29.200732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9132-203b-446f-9d93-a0eeb27f024c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:29.202352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-974a9132-203b-446f-9d93-a0eeb27f024c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:29.368240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974a9132-203b-446f-9d93-a0eeb27f024c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:29.378311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:29.488612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:29.489115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:29.489389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:29.489659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:29.491285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:29.594938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:29.596627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e70abcc-ae8c-47aa-ab6f-9bfcc68e5904 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:29.616388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 668/1363] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:31.893241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71f450-8e76-4712-b2cb-e05acbe093a5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:31.893754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71f450-8e76-4712-b2cb-e05acbe093a5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:31.894112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd71f450-8e76-4712-b2cb-e05acbe093a5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:31.895551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 696/1364] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:31 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:31.902560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f797cf-5404-4627-b94e-facca2e2f366 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:31.903034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f797cf-5404-4627-b94e-facca2e2f366 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:31.903138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f797cf-5404-4627-b94e-facca2e2f366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:31.920852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:31.988680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-71f797cf-5404-4627-b94e-facca2e2f366 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:31.990349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-71f797cf-5404-4627-b94e-facca2e2f366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:32.101447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 669/1365] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:53:32.394878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe371d8b-acdc-4d9b-9ad6-0df623106c70 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:32.396454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe371d8b-acdc-4d9b-9ad6-0df623106c70 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:32.396955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe371d8b-acdc-4d9b-9ad6-0df623106c70 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:32.398596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 697/1366] 10.222.0.72 () {54 vars in 962 bytes} [Thu Aug 25 02:53:32 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:32.404260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f8197-bda6-4751-af68-b9adc33982ae None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:32.404622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f8197-bda6-4751-af68-b9adc33982ae None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:32.404972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2f8197-bda6-4751-af68-b9adc33982ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:32.604161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ce2f8197-bda6-4751-af68-b9adc33982ae None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:32.605375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ce2f8197-bda6-4751-af68-b9adc33982ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:32.641955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:32.729068 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 670/1367] 10.222.0.72 () {58 vars in 1059 bytes} [Thu Aug 25 02:53:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:32.739051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe371d8b-acdc-4d9b-9ad6-0df623106c70 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:32.740577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fe371d8b-acdc-4d9b-9ad6-0df623106c70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:32.898633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe371d8b-acdc-4d9b-9ad6-0df623106c70 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:32.919579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:33.014974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:33.015582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:33.015886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:33.016185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:33.017769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:33.113855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:33.115454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7e5818-0d84-47fa-b461-9a3be2b52d02 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:33.134724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 698/1368] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:33.745645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb742b-f51d-4a71-ad43-d6975d5e1059 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:33.746225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb742b-f51d-4a71-ad43-d6975d5e1059 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:33.746225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54cb742b-f51d-4a71-ad43-d6975d5e1059 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:33.747536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 671/1369] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:33.753011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c6ed-e549-40d6-9051-42d8d2380d2f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:33.753412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c6ed-e549-40d6-9051-42d8d2380d2f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:33.753791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b1c6ed-e549-40d6-9051-42d8d2380d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:33.787684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:33.832288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e9b1c6ed-e549-40d6-9051-42d8d2380d2f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:33.833664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e9b1c6ed-e549-40d6-9051-42d8d2380d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:33.949436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 699/1370] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:34.520096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662744df-a102-45d0-8f10-449b7a9d5021 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:34.520677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662744df-a102-45d0-8f10-449b7a9d5021 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:34.521016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662744df-a102-45d0-8f10-449b7a9d5021 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:34.522668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 672/1371] 10.222.0.72 () {54 vars in 964 bytes} [Thu Aug 25 02:53:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:34.528015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6a05-8271-4236-8f9b-feee9f9935eb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:34.528339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6a05-8271-4236-8f9b-feee9f9935eb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:34.528620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfa6a05-8271-4236-8f9b-feee9f9935eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:34.613612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bbfa6a05-8271-4236-8f9b-feee9f9935eb None None] MFA Rules not processed for user `07c8b4d86a684c31b3bdf12e1245ac2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:34.615136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bbfa6a05-8271-4236-8f9b-feee9f9935eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:34.665341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:34.700214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 700/1372] 10.222.0.72 () {58 vars in 1061 bytes} [Thu Aug 25 02:53:34 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:34.708312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662744df-a102-45d0-8f10-449b7a9d5021 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:34.709909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-662744df-a102-45d0-8f10-449b7a9d5021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:34.823311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662744df-a102-45d0-8f10-449b7a9d5021 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:34.873815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:34.923978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:34.924808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:34.925372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:34.925750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:34.928170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:35.099294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:35.101495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5c64f5-6f9e-4ba8-b129-287456585f2b service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:35.127333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 673/1373] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:35.157067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896969e3-9d75-412a-87ec-958cfb598d6d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:35.157492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896969e3-9d75-412a-87ec-958cfb598d6d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:35.157841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896969e3-9d75-412a-87ec-958cfb598d6d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:35.159836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 701/1374] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:53:35.164679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e374-3c93-44bc-81a3-2b6d490b763e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:35.164956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e374-3c93-44bc-81a3-2b6d490b763e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:35.165336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153e374-3c93-44bc-81a3-2b6d490b763e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:35.235038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e153e374-3c93-44bc-81a3-2b6d490b763e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:35.236280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e153e374-3c93-44bc-81a3-2b6d490b763e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:35.257298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:35.337708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 674/1375] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:35.628794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896969e3-9d75-412a-87ec-958cfb598d6d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:35.630309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-896969e3-9d75-412a-87ec-958cfb598d6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:35.775197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896969e3-9d75-412a-87ec-958cfb598d6d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:35.829576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:35.894071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:35.894678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:35.894956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:35.895226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:35.896855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:35.993999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:35.995584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb771f20-0f76-47d5-acbe-e9167dcd7a09 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:36.014138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 702/1376] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:37.953629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093c94-b46b-42bc-bcde-3b67015f66ff None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:37.954109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093c94-b46b-42bc-bcde-3b67015f66ff None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:37.954224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67093c94-b46b-42bc-bcde-3b67015f66ff None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:37.955521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 675/1377] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:37.960807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc44a-2c95-446d-a967-2256d9f13fc2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:37.961206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc44a-2c95-446d-a967-2256d9f13fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:37.961356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2cc44a-2c95-446d-a967-2256d9f13fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:38.030575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3a2cc44a-2c95-446d-a967-2256d9f13fc2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:38.031853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3a2cc44a-2c95-446d-a967-2256d9f13fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:38.038740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:38.137060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 703/1378] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:38.425518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093c94-b46b-42bc-bcde-3b67015f66ff None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:38.427027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67093c94-b46b-42bc-bcde-3b67015f66ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:38.580901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67093c94-b46b-42bc-bcde-3b67015f66ff None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:38.584561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:38.738648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:38.739609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:38.739983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:38.740532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:38.742884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:38.859264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:38.861012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6deba8-8c1e-4082-823d-aad36f59ffe9 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:38.884469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 676/1379] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:40.866626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b50e-b463-4516-84d4-18e116e0d387 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:40.867198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b50e-b463-4516-84d4-18e116e0d387 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:40.867198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4704b50e-b463-4516-84d4-18e116e0d387 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:40.868905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 704/1380] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:40.874369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79007-5734-41e0-a6cb-b3fe48abd78b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:40.874815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79007-5734-41e0-a6cb-b3fe48abd78b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:40.874896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b79007-5734-41e0-a6cb-b3fe48abd78b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:40.887225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:40.951389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-82b79007-5734-41e0-a6cb-b3fe48abd78b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:40.952791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-82b79007-5734-41e0-a6cb-b3fe48abd78b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:41.056238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 677/1381] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:41.345028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704b50e-b463-4516-84d4-18e116e0d387 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:41.346733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4704b50e-b463-4516-84d4-18e116e0d387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:41.498359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:41.509929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4704b50e-b463-4516-84d4-18e116e0d387 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:41.659473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:41.660287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:41.660675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:41.661081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:41.662850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:41.764907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:41.766894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0297da8-9802-40cc-a67c-c2552390a747 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:41.778680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:41.788111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 705/1382] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:43.740314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2972-196f-43c6-9b35-be8d960f575a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:43.740882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2972-196f-43c6-9b35-be8d960f575a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:43.740882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638f2972-196f-43c6-9b35-be8d960f575a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:43.742202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 678/1383] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:43.748027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8ca4e-cda9-4955-9c1d-0c48150c01bf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:43.748503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8ca4e-cda9-4955-9c1d-0c48150c01bf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:43.748603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8ca4e-cda9-4955-9c1d-0c48150c01bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:43.823033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-40e8ca4e-cda9-4955-9c1d-0c48150c01bf None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:43.824347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-40e8ca4e-cda9-4955-9c1d-0c48150c01bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:43.924498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 706/1384] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:44.229051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2972-196f-43c6-9b35-be8d960f575a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:44.230641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-638f2972-196f-43c6-9b35-be8d960f575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:44.322685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:44.388275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638f2972-196f-43c6-9b35-be8d960f575a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:44.515299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:44.515777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:44.516071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:44.516345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:44.517966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:44.577634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:44.621423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:44.623917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a69106-cb61-458f-807b-0fd9c9906227 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:44.647617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 679/1385] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:46.648550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57e29-abc3-4e54-a374-ee78f69c994c None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:46.649151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57e29-abc3-4e54-a374-ee78f69c994c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:46.649267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce57e29-abc3-4e54-a374-ee78f69c994c None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:46.651860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 707/1386] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:46.658424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041b6c-5e16-4dad-9a47-ea44c27cb9a3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:46.658883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041b6c-5e16-4dad-9a47-ea44c27cb9a3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:46.659104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5041b6c-5e16-4dad-9a47-ea44c27cb9a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:46.732329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f5041b6c-5e16-4dad-9a47-ea44c27cb9a3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:46.733571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f5041b6c-5e16-4dad-9a47-ea44c27cb9a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:46.835159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 680/1387] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:47.216807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57e29-abc3-4e54-a374-ee78f69c994c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:47.218978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ce57e29-abc3-4e54-a374-ee78f69c994c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:47.316326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:47.391209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce57e29-abc3-4e54-a374-ee78f69c994c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:47.523944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:47.524503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:47.525312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:47.525591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:47.527288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:47.569862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:47.627564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:47.629192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc010b3-95d9-4fe5-bd8b-dcdeca3ba634 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:47.647567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 708/1388] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:49.595256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d777e-4a66-453f-97f8-944a31a97068 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:49.595828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d777e-4a66-453f-97f8-944a31a97068 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:49.595828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530d777e-4a66-453f-97f8-944a31a97068 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:49.597203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 681/1389] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:49.602380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754582b-0942-413c-88be-1f2a5e83c46e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:49.602904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754582b-0942-413c-88be-1f2a5e83c46e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:49.603050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c754582b-0942-413c-88be-1f2a5e83c46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:49.672280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c754582b-0942-413c-88be-1f2a5e83c46e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:49.673474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c754582b-0942-413c-88be-1f2a5e83c46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:49.776638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 709/1390] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:50.076109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d777e-4a66-453f-97f8-944a31a97068 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:50.077617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-530d777e-4a66-453f-97f8-944a31a97068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:50.108779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:50.224923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530d777e-4a66-453f-97f8-944a31a97068 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:50.327552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:50.340220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:50.340826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:50.341103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:50.341375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:50.342970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:50.432782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:50.434371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e9b25e-8fcc-4046-b096-7fb90dcc5e13 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:50.452649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 682/1391] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:50.594362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a544b3-3b47-4663-bf5b-7adc0d62c4fd None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:50.594779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a544b3-3b47-4663-bf5b-7adc0d62c4fd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:50.595120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a544b3-3b47-4663-bf5b-7adc0d62c4fd None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:50.596649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 710/1392] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:50.602472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7e1e8-228d-4070-a1b7-9f8d6c301674 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:50.603540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7e1e8-228d-4070-a1b7-9f8d6c301674 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:50.603630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede7e1e8-228d-4070-a1b7-9f8d6c301674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:50.674952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ede7e1e8-228d-4070-a1b7-9f8d6c301674 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:50.676202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ede7e1e8-228d-4070-a1b7-9f8d6c301674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:50.738928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:50.780277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 683/1393] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:51.086051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc87f3-a545-47cf-801b-b7f2e5192c27 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:51.086540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc87f3-a545-47cf-801b-b7f2e5192c27 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:51.086738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc87f3-a545-47cf-801b-b7f2e5192c27 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:51.088720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 711/1394] 10.222.0.72 () {54 vars in 967 bytes} [Thu Aug 25 02:53:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:51.093735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6957-66ea-4c6f-8777-50be5d6ffa9d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:51.094033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6957-66ea-4c6f-8777-50be5d6ffa9d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:51.094305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b4f6957-66ea-4c6f-8777-50be5d6ffa9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:51.175431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2b4f6957-66ea-4c6f-8777-50be5d6ffa9d None None] MFA Rules not processed for user `85776df9b5714c989ae89e7103e309d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:51.176649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b4f6957-66ea-4c6f-8777-50be5d6ffa9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:51.253470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 684/1395] 10.222.0.72 () {58 vars in 1064 bytes} [Thu Aug 25 02:53:51 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:51.261190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc87f3-a545-47cf-801b-b7f2e5192c27 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:51.262736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6bbc87f3-a545-47cf-801b-b7f2e5192c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:51.276893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:51.372728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc87f3-a545-47cf-801b-b7f2e5192c27 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:51.446493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:51.447639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:51.447913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:51.448210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:51.449803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:51.518721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:51.570928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:51.572958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e483f5dc-eddf-4b4d-b40d-21fa21ff3537 service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:51.592453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 712/1396] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:52.348841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f460d-0384-4fc2-9c55-403ad2a17bc2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:52.349347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f460d-0384-4fc2-9c55-403ad2a17bc2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:52.349459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0f460d-0384-4fc2-9c55-403ad2a17bc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:52.419015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4a0f460d-0384-4fc2-9c55-403ad2a17bc2 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:52.419724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993d4e-fd5b-40cf-8d96-527373ee0a8d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:52.420216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993d4e-fd5b-40cf-8d96-527373ee0a8d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:52.420312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4a0f460d-0384-4fc2-9c55-403ad2a17bc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:52.420423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be993d4e-fd5b-40cf-8d96-527373ee0a8d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:52.421726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 713/1397] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:52.427074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:52.427355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:52.427687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:52.428988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:52.495385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:52.496630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:52.508964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 685/1398] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 02:53:52 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:53:52.552609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e909077-dc08-4ed5-87a7-2cfeddea285d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:52.552894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e909077-dc08-4ed5-87a7-2cfeddea285d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:52.553169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e909077-dc08-4ed5-87a7-2cfeddea285d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:52.554574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 686/1399] 10.222.0.72 () {54 vars in 943 bytes} [Thu Aug 25 02:53:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:53:52.561164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:52.561453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:52.561860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:52.597781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 714/1400] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:52.640146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] MFA Rules not processed for user `bb3a4609c413473ebfdda8bddedc631c`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:52.641355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:52.724271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:52.747929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 687/1401] 10.222.0.72 () {58 vars in 1040 bytes} [Thu Aug 25 02:53:52 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:53:52.757244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:52.758559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:52.785074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:52.863359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce377e1-6d4a-4c46-808c-60a238d621b9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:52.887301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:52.888518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:52.972148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:52.972762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:52.973042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:52.973322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:52.974971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:52.992055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2ee992-43fe-4ca7-b709-6bcff80a89cb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:53.017188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:53.063146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:53.065016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b86245a-8fa4-49ae-a957-b46930263d5f service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:53.073400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 715/1402] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 02:53:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 02:53:53.101930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:53.110758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:53.111299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:53.111644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:53.111919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:53.113728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:53.229738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:53.231331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4739b697-1426-4765-8017-71e5ed9fedb6 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:53.252789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 688/1403] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:53:55.238972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d06c-2f77-4717-abe8-d07709ac1e59 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:55.239490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d06c-2f77-4717-abe8-d07709ac1e59 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:55.239490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af74d06c-2f77-4717-abe8-d07709ac1e59 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:55.241107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 716/1404] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:55.246398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdaa84-4402-4d7f-8c7f-f451d304fd76 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:55.246831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdaa84-4402-4d7f-8c7f-f451d304fd76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:55.246933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcdaa84-4402-4d7f-8c7f-f451d304fd76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:55.322570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cfcdaa84-4402-4d7f-8c7f-f451d304fd76 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:55.323801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cfcdaa84-4402-4d7f-8c7f-f451d304fd76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:55.402257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:55.443097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 689/1405] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:55.735793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d06c-2f77-4717-abe8-d07709ac1e59 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:55.737496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af74d06c-2f77-4717-abe8-d07709ac1e59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:55.908641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af74d06c-2f77-4717-abe8-d07709ac1e59 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:55.966212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:56.057822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:56.058442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:56.058747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:56.058992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:56.060640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:56.168544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:56.170155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe95add-aaa3-47e0-975b-463684fb4448 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:56.194186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 717/1406] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:53:58.189602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11da9a-84e3-42ef-ac1e-8c2fe5f7185e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:58.190137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11da9a-84e3-42ef-ac1e-8c2fe5f7185e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:58.190137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db11da9a-84e3-42ef-ac1e-8c2fe5f7185e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:58.195816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 690/1407] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:53:58 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:53:58.198129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055220-45de-482f-8690-4e728d586460 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:58.199129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055220-45de-482f-8690-4e728d586460 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:58.199731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f055220-45de-482f-8690-4e728d586460 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:58.318625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:58.340508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2f055220-45de-482f-8690-4e728d586460 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:53:58.341851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2f055220-45de-482f-8690-4e728d586460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:58.454740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 718/1408] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:53:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:53:58.754328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11da9a-84e3-42ef-ac1e-8c2fe5f7185e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:53:58.755863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-db11da9a-84e3-42ef-ac1e-8c2fe5f7185e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:58.926247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db11da9a-84e3-42ef-ac1e-8c2fe5f7185e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:53:58.995212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:53:59.070790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:53:59.071644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:53:59.071929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:53:59.072250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:53:59.074058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:53:59.178120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:53:59.179731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d591222a-6c9b-4718-a41e-324d527a41ed service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:53:59.199778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 691/1409] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:53:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:08.452794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=47 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:09.196611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=75 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:15.250564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b54b-6dc9-4760-adca-03f2596673ea None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:15.251117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b54b-6dc9-4760-adca-03f2596673ea None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:15.251117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387b54b-6dc9-4760-adca-03f2596673ea None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:15.252420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 719/1410] 10.222.0.72 () {54 vars in 918 bytes} [Thu Aug 25 02:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:15.257740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa72fe3-94e6-44cb-bae2-68edef93af76 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:15.258308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa72fe3-94e6-44cb-bae2-68edef93af76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:15.258593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa72fe3-94e6-44cb-bae2-68edef93af76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:15.334799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1fa72fe3-94e6-44cb-bae2-68edef93af76 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:15.335996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1fa72fe3-94e6-44cb-bae2-68edef93af76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:15.442734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 692/1411] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Aug 25 02:54:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:15.457144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e38161-3767-47d8-9019-5d49247d59d5 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:15.457426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e38161-3767-47d8-9019-5d49247d59d5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:15.457698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e38161-3767-47d8-9019-5d49247d59d5 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:15.459023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 720/1412] 10.222.0.72 () {54 vars in 918 bytes} [Thu Aug 25 02:54:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:15.463641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c3d0-3840-4b85-b8d1-63e5997287c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:15.463925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c3d0-3840-4b85-b8d1-63e5997287c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:15.464231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b0c3d0-3840-4b85-b8d1-63e5997287c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:15.535224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:15.537732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-46b0c3d0-3840-4b85-b8d1-63e5997287c4 None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:15.539558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46b0c3d0-3840-4b85-b8d1-63e5997287c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:15.655239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 693/1413] 10.222.0.72 () {58 vars in 1015 bytes} [Thu Aug 25 02:54:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:18.061940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e26f0-7a91-43f1-837b-7db3ba21a6c9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:18.062495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e26f0-7a91-43f1-837b-7db3ba21a6c9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:18.062495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253e26f0-7a91-43f1-837b-7db3ba21a6c9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:18.063812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:18.069307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0dbdf-37c6-42f0-b9d5-05deea686de9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:18.069700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0dbdf-37c6-42f0-b9d5-05deea686de9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:18.069875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd0dbdf-37c6-42f0-b9d5-05deea686de9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:18.134875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9bd0dbdf-37c6-42f0-b9d5-05deea686de9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:18.136096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9bd0dbdf-37c6-42f0-b9d5-05deea686de9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:18.189834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:18.231886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:18.519461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e26f0-7a91-43f1-837b-7db3ba21a6c9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:18.521177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-253e26f0-7a91-43f1-837b-7db3ba21a6c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:18.665989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253e26f0-7a91-43f1-837b-7db3ba21a6c9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:18.737873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:18.778011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:18.778542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:18.778848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:18.779139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:18.780772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:18.867454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:18.869162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8400e0c-94d2-48c3-b068-79fd79888e6e service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:18.886916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 722/1416] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:19.783747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a48cbd-f2e5-4c9c-a916-f18f7334615f None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:19.784360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a48cbd-f2e5-4c9c-a916-f18f7334615f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:19.784360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a48cbd-f2e5-4c9c-a916-f18f7334615f None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:19.785680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:19.791566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced434b-66cb-43b5-964b-19370830e106 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:19.792085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced434b-66cb-43b5-964b-19370830e106 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:19.792603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ced434b-66cb-43b5-964b-19370830e106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:19.886176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0ced434b-66cb-43b5-964b-19370830e106 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:19.887393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ced434b-66cb-43b5-964b-19370830e106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:19.918675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:20.005891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:20.165084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a48cbd-f2e5-4c9c-a916-f18f7334615f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:20.167379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-56a48cbd-f2e5-4c9c-a916-f18f7334615f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:20.331142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a48cbd-f2e5-4c9c-a916-f18f7334615f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:20.373762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:20.467529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:20.468061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:20.468349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:20.468615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:20.470227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:20.559791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:20.561415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-309431de-16c3-413d-a30d-a79df2e426e0 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:20.579303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 696/1419] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 02:54:21.459636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592a05-2b52-48ed-8539-304a4183f133 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:21.460225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592a05-2b52-48ed-8539-304a4183f133 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:21.460225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83592a05-2b52-48ed-8539-304a4183f133 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:21.461606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:21.466692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae19e9-6d64-4b29-bc13-0274e1c935ac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:21.467118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae19e9-6d64-4b29-bc13-0274e1c935ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:21.467213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aae19e9-6d64-4b29-bc13-0274e1c935ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:21.521819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:21.545589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1aae19e9-6d64-4b29-bc13-0274e1c935ac None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:21.546803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1aae19e9-6d64-4b29-bc13-0274e1c935ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:21.642184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:21.797938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83592a05-2b52-48ed-8539-304a4183f133 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:21.799443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-83592a05-2b52-48ed-8539-304a4183f133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:21.944068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83592a05-2b52-48ed-8539-304a4183f133 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:21.957009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:22.061736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:22.062343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:22.062621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:22.062892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:22.064559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:22.153624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:22.155210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcdfa26-19b3-45b2-a9d7-98ce2f418b26 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:22.172752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 725/1422] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:23.034373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918616af-a4de-4586-ba29-800ff41f050b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:23.034914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918616af-a4de-4586-ba29-800ff41f050b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:23.034914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918616af-a4de-4586-ba29-800ff41f050b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:23.036289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:23.041706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49397b3-8c13-4fe7-852c-6c808b9aad58 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:23.042109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49397b3-8c13-4fe7-852c-6c808b9aad58 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:23.042288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49397b3-8c13-4fe7-852c-6c808b9aad58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:23.062287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:23.117524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c49397b3-8c13-4fe7-852c-6c808b9aad58 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:23.119456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c49397b3-8c13-4fe7-852c-6c808b9aad58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:23.216432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:23.366021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918616af-a4de-4586-ba29-800ff41f050b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:23.367568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-918616af-a4de-4586-ba29-800ff41f050b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:23.477340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:23.513971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918616af-a4de-4586-ba29-800ff41f050b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:23.625621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:23.626218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:23.626495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:23.626768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:23.628387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:23.703060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:23.717681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:23.719256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d52f18-2686-4739-8f48-25f503bca9af service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:23.736892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 699/1425] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:24.603360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c688676-e7f5-4667-9212-4096a05f0757 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:24.603951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c688676-e7f5-4667-9212-4096a05f0757 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:24.603951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c688676-e7f5-4667-9212-4096a05f0757 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:24.605281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:24.610119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c223c-7734-468a-b002-36ae865c623f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:24.610498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c223c-7734-468a-b002-36ae865c623f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:24.610694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955c223c-7734-468a-b002-36ae865c623f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:24.684998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-955c223c-7734-468a-b002-36ae865c623f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:24.686186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-955c223c-7734-468a-b002-36ae865c623f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:24.781482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:24.930484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c688676-e7f5-4667-9212-4096a05f0757 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:24.932029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2c688676-e7f5-4667-9212-4096a05f0757 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:25.013826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:25.082969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c688676-e7f5-4667-9212-4096a05f0757 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:25.195205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:25.195726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:25.196009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:25.196824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:25.198449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:25.247184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:25.288093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:25.289696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78feb869-849d-49ec-8057-db5acd9be9c1 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:25.308654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 728/1428] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:26.114479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb02c-f0b0-4905-ad5c-e3e23f84352b None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:26.115044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb02c-f0b0-4905-ad5c-e3e23f84352b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:26.115157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427bb02c-f0b0-4905-ad5c-e3e23f84352b None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:26.116552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:26.121459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147194-481c-4aaf-9e2d-27633d87cf3a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:26.121890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147194-481c-4aaf-9e2d-27633d87cf3a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:26.122000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5147194-481c-4aaf-9e2d-27633d87cf3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:26.197631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f5147194-481c-4aaf-9e2d-27633d87cf3a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:26.198734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f5147194-481c-4aaf-9e2d-27633d87cf3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:26.293989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:26.444384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bb02c-f0b0-4905-ad5c-e3e23f84352b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:26.445904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-427bb02c-f0b0-4905-ad5c-e3e23f84352b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:26.496884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:26.594692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427bb02c-f0b0-4905-ad5c-e3e23f84352b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:26.711214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:26.711844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:26.712151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:26.712429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:26.714088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:26.721100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:26.806241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:26.807853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd99c3ef-bce6-4adc-93bc-046bd11c4790 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:26.825627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 702/1431] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:27.637748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf8ce7-17b4-4935-b542-09448285983f None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:27.638281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf8ce7-17b4-4935-b542-09448285983f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:27.638281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceaf8ce7-17b4-4935-b542-09448285983f None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:27.639641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:27.644627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe778a-e275-4ed5-98cf-147f51c80d47 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:27.645037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe778a-e275-4ed5-98cf-147f51c80d47 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:27.645205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fe778a-e275-4ed5-98cf-147f51c80d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:27.720628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-83fe778a-e275-4ed5-98cf-147f51c80d47 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:27.721855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-83fe778a-e275-4ed5-98cf-147f51c80d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:27.788916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:27.820500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:27.971195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf8ce7-17b4-4935-b542-09448285983f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:27.972731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ceaf8ce7-17b4-4935-b542-09448285983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:27.990689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:28.120467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceaf8ce7-17b4-4935-b542-09448285983f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:28.205586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:28.232185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:28.232786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:28.233057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:28.233320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:28.234895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:28.323315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:28.324954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d05cb1d-435a-46e1-b8b7-da9d0211ba91 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:28.342435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 731/1434] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:29.153810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d84de-c5a4-4fb8-b988-7bdf342d40b6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:29.154356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d84de-c5a4-4fb8-b988-7bdf342d40b6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:29.154356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d84de-c5a4-4fb8-b988-7bdf342d40b6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:29.155748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:29.160693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45850c-cee1-4f7d-9c7b-cfe68eabb6d5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:29.161101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45850c-cee1-4f7d-9c7b-cfe68eabb6d5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:29.161232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc45850c-cee1-4f7d-9c7b-cfe68eabb6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:29.236379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bc45850c-cee1-4f7d-9c7b-cfe68eabb6d5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:29.237846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc45850c-cee1-4f7d-9c7b-cfe68eabb6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:29.280769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:29.335081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:29.484469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d84de-c5a4-4fb8-b988-7bdf342d40b6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:29.485977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e0d84de-c5a4-4fb8-b988-7bdf342d40b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:29.628928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d84de-c5a4-4fb8-b988-7bdf342d40b6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:29.683010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:29.741293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:29.741898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:29.742176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:29.742446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:29.744823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:29.832935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:29.834520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e00df1c-aded-4f68-82e3-f6ce4c88e9da service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:29.852288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 705/1437] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:30.666644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc62a-2679-4338-a52c-9a42a7eceab1 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:30.667181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc62a-2679-4338-a52c-9a42a7eceab1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:30.667278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29fc62a-2679-4338-a52c-9a42a7eceab1 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:30.668644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:54:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:30.673648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d7cbf-48c3-46aa-ac34-c81204a25c9a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:30.674082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d7cbf-48c3-46aa-ac34-c81204a25c9a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:30.674177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d7cbf-48c3-46aa-ac34-c81204a25c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:30.750360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1d1d7cbf-48c3-46aa-ac34-c81204a25c9a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:30.751556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1d1d7cbf-48c3-46aa-ac34-c81204a25c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:30.753556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:30.850505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:31.001709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc62a-2679-4338-a52c-9a42a7eceab1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:31.003238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c29fc62a-2679-4338-a52c-9a42a7eceab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:31.147739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29fc62a-2679-4338-a52c-9a42a7eceab1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:31.174429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:31.260166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:31.260681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:31.260953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:31.261221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:31.262801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:31.351032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:31.353144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dc26be-0a7c-4dfc-8a54-71be7ec6c329 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:31.371959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 734/1440] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:33.202809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5dd2b-0037-4d6b-a860-56f6995cbe17 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:33.203327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5dd2b-0037-4d6b-a860-56f6995cbe17 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:33.203327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa5dd2b-0037-4d6b-a860-56f6995cbe17 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:33.204648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:33.209998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40315cf-21a4-468f-9b3c-6219d26825ab None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:33.210400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40315cf-21a4-468f-9b3c-6219d26825ab None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:33.210546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40315cf-21a4-468f-9b3c-6219d26825ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:33.252156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:33.278643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b40315cf-21a4-468f-9b3c-6219d26825ab None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:33.279845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b40315cf-21a4-468f-9b3c-6219d26825ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:33.377835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:54:33.666749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5dd2b-0037-4d6b-a860-56f6995cbe17 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:33.668311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4aa5dd2b-0037-4d6b-a860-56f6995cbe17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:33.768734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa5dd2b-0037-4d6b-a860-56f6995cbe17 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:33.802235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:33.842946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:33.843539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:33.843810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:33.844098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:33.845681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:33.954160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:33.955575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01f9aa27-4913-4c88-b1d2-139b3493e4db service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:33.974252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 708/1443] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:36.019557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7728b4d-ca93-47ef-929b-288e20663be8 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:36.020219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7728b4d-ca93-47ef-929b-288e20663be8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:36.020219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7728b4d-ca93-47ef-929b-288e20663be8 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:36.021594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:36.027561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a344-642a-4277-bce4-bfb37c7cbb4b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:36.027987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a344-642a-4277-bce4-bfb37c7cbb4b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:36.028125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07a344-642a-4277-bce4-bfb37c7cbb4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:36.092817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5a07a344-642a-4277-bce4-bfb37c7cbb4b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:36.093996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a07a344-642a-4277-bce4-bfb37c7cbb4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:36.107070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:36.189136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:36.472279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7728b4d-ca93-47ef-929b-288e20663be8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:36.473864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b7728b4d-ca93-47ef-929b-288e20663be8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:36.575982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7728b4d-ca93-47ef-929b-288e20663be8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:36.590496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:36.653340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:36.653942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:36.654219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:36.654486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:36.656166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:36.763495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:36.764877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07691378-3613-45aa-ae21-ed747421ae52 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:36.783353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 737/1446] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:39.008347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04070-0624-45cd-a1c6-4b900db32397 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:39.009889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04070-0624-45cd-a1c6-4b900db32397 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:39.009889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a04070-0624-45cd-a1c6-4b900db32397 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:39.011194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:39.016755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd3034-76c6-460e-a7a9-654de104f148 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:39.017210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd3034-76c6-460e-a7a9-654de104f148 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:39.017325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1bd3034-76c6-460e-a7a9-654de104f148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:39.065539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:39.083998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c1bd3034-76c6-460e-a7a9-654de104f148 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:39.085222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c1bd3034-76c6-460e-a7a9-654de104f148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:39.180198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:39.472922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04070-0624-45cd-a1c6-4b900db32397 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:39.474470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-39a04070-0624-45cd-a1c6-4b900db32397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:39.578104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a04070-0624-45cd-a1c6-4b900db32397 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:39.616834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:39.651366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:39.651962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:39.652267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:39.652538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:39.654142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:39.761397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:39.762822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e573c-97e4-43bd-b5fe-495d99ec89bc service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:39.781436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 711/1449] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:41.818243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe94c1-1411-45ff-bcea-746ac12b5f8d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:41.818822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe94c1-1411-45ff-bcea-746ac12b5f8d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:41.818822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe94c1-1411-45ff-bcea-746ac12b5f8d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:41.820163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:41.825652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32941c-d9b7-4e10-8c27-d02e0575bab2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:41.826043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32941c-d9b7-4e10-8c27-d02e0575bab2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:41.826202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc32941c-d9b7-4e10-8c27-d02e0575bab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:41.891394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fc32941c-d9b7-4e10-8c27-d02e0575bab2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:41.892627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fc32941c-d9b7-4e10-8c27-d02e0575bab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:41.913343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:41.990260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:42.273223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe94c1-1411-45ff-bcea-746ac12b5f8d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:42.275313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cbbe94c1-1411-45ff-bcea-746ac12b5f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:42.379371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe94c1-1411-45ff-bcea-746ac12b5f8d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:42.400586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:42.454257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:42.454867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:42.455145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:42.455414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:42.457089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:42.565333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:42.566671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46697f3-5d28-4569-a799-366ceb69913a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:42.584940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 740/1452] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:44.561723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9db9e-b593-4620-82e2-b4e557b19915 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:44.562288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9db9e-b593-4620-82e2-b4e557b19915 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:44.562288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9db9e-b593-4620-82e2-b4e557b19915 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:44.563648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:54:44.568939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5323fd-17f7-4171-ba92-99b96adeb704 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:44.569371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5323fd-17f7-4171-ba92-99b96adeb704 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:44.569478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5323fd-17f7-4171-ba92-99b96adeb704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:44.631707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:44.634702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3a5323fd-17f7-4171-ba92-99b96adeb704 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:44.636519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3a5323fd-17f7-4171-ba92-99b96adeb704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:44.739099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:45.020803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9db9e-b593-4620-82e2-b4e557b19915 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:45.022339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-96c9db9e-b593-4620-82e2-b4e557b19915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:45.126246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9db9e-b593-4620-82e2-b4e557b19915 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:45.174598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:45.199027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:45.199564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:45.199840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:45.200140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:45.201734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:45.311464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:45.312930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a0fa49-1f46-4668-86d9-c9a8a95c11c4 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:45.331885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 714/1455] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:47.406207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0236eac-f369-4105-9a9f-2ce8e709ef81 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:47.406726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0236eac-f369-4105-9a9f-2ce8e709ef81 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:47.406726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0236eac-f369-4105-9a9f-2ce8e709ef81 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:47.408127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:47.413434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad746-f5ba-4478-a798-8bd020175183 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:47.413835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad746-f5ba-4478-a798-8bd020175183 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:47.413979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5ad746-f5ba-4478-a798-8bd020175183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:47.482052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bb5ad746-f5ba-4478-a798-8bd020175183 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:47.483263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bb5ad746-f5ba-4478-a798-8bd020175183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:47.512506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:47.579684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:54:47.863504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0236eac-f369-4105-9a9f-2ce8e709ef81 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:47.865072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b0236eac-f369-4105-9a9f-2ce8e709ef81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:47.969208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0236eac-f369-4105-9a9f-2ce8e709ef81 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:47.997452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:48.042568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:48.043167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:48.043441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:48.043707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:48.045338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:48.154442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:48.155910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49b80f67-3551-4eb3-bb85-0fb35990f424 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:48.173528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 743/1458] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:50.130986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50d4f-70d8-4986-ad6f-adbbe1f0481c None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:50.131550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50d4f-70d8-4986-ad6f-adbbe1f0481c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:50.131550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b50d4f-70d8-4986-ad6f-adbbe1f0481c None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:50.132953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:50.138568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ba75-44ad-4194-9f5c-92d66955a0b6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:50.138975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ba75-44ad-4194-9f5c-92d66955a0b6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:50.139103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f3ba75-44ad-4194-9f5c-92d66955a0b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:50.204258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-75f3ba75-44ad-4194-9f5c-92d66955a0b6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:50.205377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-75f3ba75-44ad-4194-9f5c-92d66955a0b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:50.214039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:50.303858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:50.585069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b50d4f-70d8-4986-ad6f-adbbe1f0481c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:50.586634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d2b50d4f-70d8-4986-ad6f-adbbe1f0481c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:50.689546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b50d4f-70d8-4986-ad6f-adbbe1f0481c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:50.747836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:50.766733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:50.767332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:50.767610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:50.767880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:50.769579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:50.876884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:50.878308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef523c8-ebc0-4cb0-abbc-bb1fe34ef727 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:50.896409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 717/1461] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:52.846977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3f39-f328-4b20-8d76-199ad25e969d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:52.847546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3f39-f328-4b20-8d76-199ad25e969d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:52.847546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50be3f39-f328-4b20-8d76-199ad25e969d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:52.848908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:52.855051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819da959-ddaf-45af-81a0-0cd57143fecd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:52.855480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819da959-ddaf-45af-81a0-0cd57143fecd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:52.855593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819da959-ddaf-45af-81a0-0cd57143fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:52.921931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-819da959-ddaf-45af-81a0-0cd57143fecd None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:52.923127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-819da959-ddaf-45af-81a0-0cd57143fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:52.962223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:53.020132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:53.308240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3f39-f328-4b20-8d76-199ad25e969d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:53.309760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-50be3f39-f328-4b20-8d76-199ad25e969d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:53.414217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50be3f39-f328-4b20-8d76-199ad25e969d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:53.451313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:53.487127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:53.487726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:53.488006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:53.488312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:53.489984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:53.598318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:53.599750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028aaf64-c02f-45d0-bc48-6f10388fddc2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:53.617549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 746/1464] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:55.552816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bfefc-558a-4b35-8507-b8080a20faeb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:55.553367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bfefc-558a-4b35-8507-b8080a20faeb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:55.553367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12bfefc-558a-4b35-8507-b8080a20faeb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:55.554711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:55.560953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a225e-c298-436d-b9b2-0a15eb8bd44b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:55.561368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a225e-c298-436d-b9b2-0a15eb8bd44b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:55.561581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334a225e-c298-436d-b9b2-0a15eb8bd44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:55.627109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-334a225e-c298-436d-b9b2-0a15eb8bd44b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:55.628255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-334a225e-c298-436d-b9b2-0a15eb8bd44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:55.646563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:55.725033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:56.012743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bfefc-558a-4b35-8507-b8080a20faeb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:56.014271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a12bfefc-558a-4b35-8507-b8080a20faeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:56.115837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12bfefc-558a-4b35-8507-b8080a20faeb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:56.182787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:56.190058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:56.190618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:56.190897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:56.191171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:56.192820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:56.300678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:56.302096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09836c7-4b16-4949-9160-f0fb06f1b57a service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:56.320270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 720/1467] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:54:58.254026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17c02-4010-431f-a0b7-f3ce5edbf80d None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:58.254548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17c02-4010-431f-a0b7-f3ce5edbf80d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:58.254548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e17c02-4010-431f-a0b7-f3ce5edbf80d None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:58.255865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:54:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:54:58.261669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8c99-2a79-4992-8416-73dae3231b23 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:58.262058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8c99-2a79-4992-8416-73dae3231b23 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:58.262217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f8c99-2a79-4992-8416-73dae3231b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:58.327755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-640f8c99-2a79-4992-8416-73dae3231b23 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:54:58.328992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-640f8c99-2a79-4992-8416-73dae3231b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:58.376964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:58.425442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:54:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:54:58.708120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17c02-4010-431f-a0b7-f3ce5edbf80d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:54:58.709648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-09e17c02-4010-431f-a0b7-f3ce5edbf80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:58.812881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e17c02-4010-431f-a0b7-f3ce5edbf80d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:54:58.861487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:54:58.888470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:54:58.889075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:54:58.889354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:54:58.889625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:54:58.891235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:54:58.999951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:54:59.001346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8468fd76-bf00-448d-bd56-b87991682b6b service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:54:59.020236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 749/1470] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:54:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:08.423622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=22 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:09.017898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=66 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:18.501506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83f50-b67d-47ac-8d63-ad5231b4e306 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:18.502081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83f50-b67d-47ac-8d63-ad5231b4e306 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:18.502081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f83f50-b67d-47ac-8d63-ad5231b4e306 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:18.503435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 722/1471] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:18.508593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11c4f-a671-4d11-909e-e7e78a045dbc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:18.509050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11c4f-a671-4d11-909e-e7e78a045dbc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:18.509149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d11c4f-a671-4d11-909e-e7e78a045dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:18.577351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-43d11c4f-a671-4d11-909e-e7e78a045dbc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:18.578549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-43d11c4f-a671-4d11-909e-e7e78a045dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:18.674578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 750/1472] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:55:18.969196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e567b69-a8e2-4680-9eae-db74368ba77e None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:18.969478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e567b69-a8e2-4680-9eae-db74368ba77e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:18.969754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e567b69-a8e2-4680-9eae-db74368ba77e None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:18.971109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 723/1473] 10.222.0.72 () {54 vars in 967 bytes} [Thu Aug 25 02:55:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:18.975718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271183-7915-4412-b4b3-147cdc931ab2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:18.976002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271183-7915-4412-b4b3-147cdc931ab2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:18.976295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8271183-7915-4412-b4b3-147cdc931ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:19.054940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c8271183-7915-4412-b4b3-147cdc931ab2 None None] MFA Rules not processed for user `85776df9b5714c989ae89e7103e309d5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:19.056333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c8271183-7915-4412-b4b3-147cdc931ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:19.077235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:19.132573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 751/1474] 10.222.0.72 () {58 vars in 1064 bytes} [Thu Aug 25 02:55:18 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:55:19.140903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e567b69-a8e2-4680-9eae-db74368ba77e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:19.142422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2e567b69-a8e2-4680-9eae-db74368ba77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:19.245955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e567b69-a8e2-4680-9eae-db74368ba77e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:19.317882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:19.318479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:19.318757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:19.319028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:19.321232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:19.375564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:19.431238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:19.432704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4633afe-dbff-48b3-b99e-7ec7c0136d4e service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:19.452513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 724/1475] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:55:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:21.594613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf53d-9e68-4ad0-a22d-3e76dd0b15bb None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:21.595165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf53d-9e68-4ad0-a22d-3e76dd0b15bb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:21.595165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaaf53d-9e68-4ad0-a22d-3e76dd0b15bb None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:21.596589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 752/1476] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:21.602277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58a0f-16b4-446e-880f-8abb225157da None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:21.602942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58a0f-16b4-446e-880f-8abb225157da None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:21.602942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c58a0f-16b4-446e-880f-8abb225157da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:21.667830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-19c58a0f-16b4-446e-880f-8abb225157da None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:21.669055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-19c58a0f-16b4-446e-880f-8abb225157da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:21.766122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 725/1477] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:55:22.040760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf53d-9e68-4ad0-a22d-3e76dd0b15bb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:22.042306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7aaaf53d-9e68-4ad0-a22d-3e76dd0b15bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:22.167403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaaf53d-9e68-4ad0-a22d-3e76dd0b15bb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:22.216574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:22.262377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:22.262974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:22.263250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:22.263518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:22.264193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:22.266007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:55:22.266007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 02:55:22.266007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 02:55:22.267163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ae3672-1bcc-4ebb-8caa-188dbc167935 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:22.287496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 753/1478] 10.222.0.72 () {56 vars in 1108 bytes} [Thu Aug 25 02:55:22 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:55:24.207884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f0cba-cb65-467e-8797-2a8325777080 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:24.208433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f0cba-cb65-467e-8797-2a8325777080 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:24.208433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb6f0cba-cb65-467e-8797-2a8325777080 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:24.209701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 726/1479] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:24.215413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279c889-915f-41f3-9d64-d2388658cd15 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:24.215857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279c889-915f-41f3-9d64-d2388658cd15 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:24.215963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4279c889-915f-41f3-9d64-d2388658cd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:24.282801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4279c889-915f-41f3-9d64-d2388658cd15 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:24.284031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4279c889-915f-41f3-9d64-d2388658cd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:24.380341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 754/1480] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:55:24.672229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f0cba-cb65-467e-8797-2a8325777080 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:24.673778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fb6f0cba-cb65-467e-8797-2a8325777080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:24.688227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:24.823858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb6f0cba-cb65-467e-8797-2a8325777080 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:24.902731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:24.936032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:24.936589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:24.936863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:24.937131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:24.938717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:25.026700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:25.028296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086ccde5-5451-4511-ba99-9d2ed53a04d4 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:25.045844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 727/1481] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:55:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:27.146709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4760-d2a8-41ae-990a-c3a0c7aad94e None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:27.147293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4760-d2a8-41ae-990a-c3a0c7aad94e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:27.147293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68a4760-d2a8-41ae-990a-c3a0c7aad94e None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:27.149156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 755/1482] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:27.154611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e969336-b41a-40d9-8df0-190bbbbeee00 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:27.155053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e969336-b41a-40d9-8df0-190bbbbeee00 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:27.155161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e969336-b41a-40d9-8df0-190bbbbeee00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:27.222690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4e969336-b41a-40d9-8df0-190bbbbeee00 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:27.223793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4e969336-b41a-40d9-8df0-190bbbbeee00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:27.272175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:27.322340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 728/1483] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:55:27.612721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4760-d2a8-41ae-990a-c3a0c7aad94e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:27.614251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d68a4760-d2a8-41ae-990a-c3a0c7aad94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:27.638529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:27.718396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68a4760-d2a8-41ae-990a-c3a0c7aad94e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:27.790705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:27.791303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:27.791579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:27.791847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:27.793475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:27.866424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:27.901665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:27.903106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811130db-7d78-43ab-b73b-3a19e046c85e service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:27.921775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 756/1484] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:55:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:29.888372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdabe9-91fd-4eaf-a72d-e5f0f77782d6 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:29.888927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdabe9-91fd-4eaf-a72d-e5f0f77782d6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:29.888927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fdabe9-91fd-4eaf-a72d-e5f0f77782d6 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:29.890266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 729/1485] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:29.895523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a646-fe81-4422-a7c1-252ceb0e3408 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:29.896029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a646-fe81-4422-a7c1-252ceb0e3408 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:29.896202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea33a646-fe81-4422-a7c1-252ceb0e3408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:29.965745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ea33a646-fe81-4422-a7c1-252ceb0e3408 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:29.966970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea33a646-fe81-4422-a7c1-252ceb0e3408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:30.062096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 757/1486] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:55:30.354914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdabe9-91fd-4eaf-a72d-e5f0f77782d6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:30.356500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-04fdabe9-91fd-4eaf-a72d-e5f0f77782d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:30.460312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fdabe9-91fd-4eaf-a72d-e5f0f77782d6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:30.532192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:30.534059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:30.534719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:30.535152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:30.535330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:30.537551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:30.645852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:30.647270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251926-78d5-4bbc-97a9-367ffccc688f service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:30.666234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 730/1487] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:55:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:32.684300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c26e-29d2-4073-9354-52f3f6ac3017 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:32.684864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c26e-29d2-4073-9354-52f3f6ac3017 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:32.684864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb9c26e-29d2-4073-9354-52f3f6ac3017 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:32.686239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 758/1488] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:32.691531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bfaef-063e-4d82-b34d-688845d331cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:32.691981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bfaef-063e-4d82-b34d-688845d331cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:32.692129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7bfaef-063e-4d82-b34d-688845d331cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:32.757815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2d7bfaef-063e-4d82-b34d-688845d331cc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:32.759094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2d7bfaef-063e-4d82-b34d-688845d331cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:32.810709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:32.854344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 731/1489] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:55:33.147368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c26e-29d2-4073-9354-52f3f6ac3017 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:33.149523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5fb9c26e-29d2-4073-9354-52f3f6ac3017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:33.185607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:33.254691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb9c26e-29d2-4073-9354-52f3f6ac3017 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:33.328360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:33.328960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:33.329234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:33.329502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:33.331088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:33.411887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:33.441417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:33.442861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0222c4f6-bcad-46c8-a1fe-b43af9d3b25d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:33.461840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 759/1490] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:55:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:35.576538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c4f0-a053-491d-ad97-4052170d82ed None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:35.577092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c4f0-a053-491d-ad97-4052170d82ed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:35.577092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d0c4f0-a053-491d-ad97-4052170d82ed None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:35.578451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 732/1491] 10.222.0.72 () {54 vars in 927 bytes} [Thu Aug 25 02:55:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:55:35.583768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192584-d046-4b84-9d37-977edce8ea63 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:35.584223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192584-d046-4b84-9d37-977edce8ea63 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:35.584357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50192584-d046-4b84-9d37-977edce8ea63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:35.649725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-50192584-d046-4b84-9d37-977edce8ea63 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:55:35.650851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-50192584-d046-4b84-9d37-977edce8ea63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:35.752990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 760/1492] 10.222.0.72 () {58 vars in 1024 bytes} [Thu Aug 25 02:55:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:55:36.047968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0c4f0-a053-491d-ad97-4052170d82ed None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:55:36.049544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8d0c4f0-a053-491d-ad97-4052170d82ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:36.152427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d0c4f0-a053-491d-ad97-4052170d82ed None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:55:36.227680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:55:36.228241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:55:36.228524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:55:36.228797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:55:36.230394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:55:36.239456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:36.340872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:55:36.342287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87062a96-27f5-403f-8663-a7ecec83e75a service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:55:36.360000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 733/1493] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:55:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:55:45.751150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=82 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:55:46.357679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=50 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:47.664722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.665282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.665918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.741858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.743065 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:47.838883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 761/1494] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:47.846990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:47.847476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:47.847580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:47.922440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:47.923554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.022686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 734/1495] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 02:56:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:48.027334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.028572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.040449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58284ecc-2bb0-42e0-9faf-c9c1b891d760 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.100755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.135293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.135896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.136203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.136469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.137107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 02:56:48.137404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.138422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:48.138422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 02:56:48.138422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 02:56:48.139287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.150894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 762/1496] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:56:48.159224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.168450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb682f-2c68-4b81-97fc-0917c806fb39 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.230098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.264373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.264980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.265257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.265529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.266145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.267867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:48.267867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 02:56:48.267867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 02:56:48.269088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.324351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 735/1497] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 02:56:48 2022] POST /identity/v3/projects => generated 379 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:48.328529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.330051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.363426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35368ca7-3677-4013-8792-852769e91964 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.459137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.459741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.460020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.460322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.460943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.461960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:48.461960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 02:56:48.461960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 02:56:48.463165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.505307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 763/1498] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 02:56:48 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 02:56:48.510348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.511886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.573061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7171f9f5-55e9-4dc0-ae9b-6fe8702ffcb1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.657246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.668290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.668894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.669172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.669443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.670087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.671092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:48.671092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 02:56:48.671092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 02:56:48.671977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.684994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 736/1499] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:48.689149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.690669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.703101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1465ad9c-5486-4806-8b5f-7ea7e095571b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.728003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:48.798063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.798711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.799010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.799257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.799893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.800949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:48.800949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 02:56:48.800949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 02:56:48.801821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76847c42-192a-4036-b7ed-c65b36278fbe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:48.815017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 764/1500] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 02:56:48 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 02:56:48.819453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:48.821056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:48.854086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1a17e8-a049-4762-836d-52354b8e6e55 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:48.948944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:48.949607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:48.949889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:48.950163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] PATH_INFO: `/v3/projects/7db3e271523d46f3988140da5974191a/users/b1e2466fd61244feb3c62cd3749333cb/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:48.973911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7db3e271523d46f3988140da5974191a, user_id=b1e2466fd61244feb3c62cd3749333cb, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:48.974975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:48.974975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 02:56:48.974975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 02:56:48.977025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2330c6f-dd8c-4ef1-8b8e-6b186c50dc94 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.000751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 737/1501] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 02:56:48 2022] PUT /identity/v3/projects/7db3e271523d46f3988140da5974191a/users/b1e2466fd61244feb3c62cd3749333cb/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:49.013902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c73e-e736-4c28-848c-08c8846c999b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.014189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c73e-e736-4c28-848c-08c8846c999b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.014462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea54c73e-e736-4c28-848c-08c8846c999b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.071947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ea54c73e-e736-4c28-848c-08c8846c999b None None] MFA Rules not processed for user `b1e2466fd61244feb3c62cd3749333cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:49.073152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea54c73e-e736-4c28-848c-08c8846c999b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.149980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 765/1502] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:49.162987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525be60a-94d9-4331-9d12-53164af182c9 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.163271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525be60a-94d9-4331-9d12-53164af182c9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.163549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525be60a-94d9-4331-9d12-53164af182c9 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.164916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 738/1503] 10.222.0.72 () {54 vars in 964 bytes} [Thu Aug 25 02:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:49.169663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786812f-306a-49d9-87d5-522c493b5fa5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.169947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786812f-306a-49d9-87d5-522c493b5fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.170225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2786812f-306a-49d9-87d5-522c493b5fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.201931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:49.245809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2786812f-306a-49d9-87d5-522c493b5fa5 None None] MFA Rules not processed for user `07c8b4d86a684c31b3bdf12e1245ac2d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:49.247009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2786812f-306a-49d9-87d5-522c493b5fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.322106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 766/1504] 10.222.0.72 () {58 vars in 1061 bytes} [Thu Aug 25 02:56:49 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:49.329824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525be60a-94d9-4331-9d12-53164af182c9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.331382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-525be60a-94d9-4331-9d12-53164af182c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.382226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:49.436749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525be60a-94d9-4331-9d12-53164af182c9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.510415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.511015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.511324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.511597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.513248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.610302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.611719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.615152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:49.630157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 739/1505] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:49.674876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46cc2-646f-4cec-ba7f-184935cc69fe None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.675193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46cc2-646f-4cec-ba7f-184935cc69fe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.675470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e46cc2-646f-4cec-ba7f-184935cc69fe None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.676774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 767/1506] 10.222.0.72 () {52 vars in 830 bytes} [Thu Aug 25 02:56:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:56:49.681066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:49.682812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:49.780483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78414f5-e2c2-481f-8c30-1346d4e8ac93 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:49.872817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:49.873414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:49.873633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:49.873902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] PATH_INFO: `/v3/users/b1e2466fd61244feb3c62cd3749333cb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:49.886201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b1e2466fd61244feb3c62cd3749333cb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:49.887214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:49.887214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 02:56:49.887214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 02:56:49.888461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:49.898823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:49.958745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b1e2466fd61244feb3c62cd3749333cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:49.960488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b1e2466fd61244feb3c62cd3749333cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:49.984735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b1e2466fd61244feb3c62cd3749333cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:49.994883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b1e2466fd61244feb3c62cd3749333cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.009435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b1e2466fd61244feb3c62cd3749333cb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:50.014899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 740/1507] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 02:56:49 2022] DELETE /identity/v3/users/b1e2466fd61244feb3c62cd3749333cb => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:56:50.019452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:50.019912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:50.020060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:50.078096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:56:50.079303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:50.153449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:50.171245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 768/1508] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 02:56:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:56:50.180909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:50.182131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:50.281851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70629a62-19ba-4a07-a09b-44026cf2a76c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:50.335900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:56:50.355565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:50.356199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:50.356476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:50.356745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:50.358315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:50.464002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:50.465375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aadbc34-7733-4f02-bc0c-b6387a5556ea service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:50.483826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 741/1509] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:56:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:56:50.978316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:56:50.979596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:56:50.991545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2158cc5-36c1-46b1-bc45-0b128cf465be None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:56:51.089703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:56:51.090336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:56:51.090588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:56:51.090853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] PATH_INFO: `/v3/projects/7db3e271523d46f3988140da5974191a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:56:51.101034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7db3e271523d46f3988140da5974191a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:56:51.102046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 02:56:51.102046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 02:56:51.102046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 02:56:51.103238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:56:51.159361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7db3e271523d46f3988140da5974191a', 'request_id': 'req-a1d9ab09-1785-40be-b46a-9e655e37a8a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:51.165844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7db3e271523d46f3988140da5974191a', 'request_id': 'req-a1d9ab09-1785-40be-b46a-9e655e37a8a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:51.176318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7db3e271523d46f3988140da5974191a', 'request_id': 'req-a1d9ab09-1785-40be-b46a-9e655e37a8a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:51.207325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] The token cache is being invalidate because project 7db3e271523d46f3988140da5974191a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 02:56:51.207612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:51.208176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a1d9ab09-1785-40be-b46a-9e655e37a8a6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 02:56:51.209650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 769/1510] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 02:56:50 2022] DELETE /identity/v3/projects/7db3e271523d46f3988140da5974191a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 02:57:00.481757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=62 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:57:01.205284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:30.191909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686865-ea40-4280-aada-8672bf16618a None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:30.192531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686865-ea40-4280-aada-8672bf16618a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:30.192531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07686865-ea40-4280-aada-8672bf16618a None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:30.193795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:58:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:30.198592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e47c-3d6b-4602-9542-7c1b9f1a60ef None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:30.199037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e47c-3d6b-4602-9542-7c1b9f1a60ef None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:30.199177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b472e47c-3d6b-4602-9542-7c1b9f1a60ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:30.280373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b472e47c-3d6b-4602-9542-7c1b9f1a60ef None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:30.281570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b472e47c-3d6b-4602-9542-7c1b9f1a60ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:30.506737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:58:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:30.662295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686865-ea40-4280-aada-8672bf16618a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:30.664453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07686865-ea40-4280-aada-8672bf16618a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:30.786106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07686865-ea40-4280-aada-8672bf16618a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:30.791645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb68d7d5-00b6-44e3-99be-acbad895ccf4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:30.792577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d7d5-00b6-44e3-99be-acbad895ccf4 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:30.792879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d7d5-00b6-44e3-99be-acbad895ccf4 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:30.793157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb68d7d5-00b6-44e3-99be-acbad895ccf4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:30.801525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d7d5-00b6-44e3-99be-acbad895ccf4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:30.803112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb68d7d5-00b6-44e3-99be-acbad895ccf4 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:30.812657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 743/1513] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:31.321226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba3b1-55de-48e6-a3ce-8c7a5f418758 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:31.321782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba3b1-55de-48e6-a3ce-8c7a5f418758 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:31.321886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6fba3b1-55de-48e6-a3ce-8c7a5f418758 None None] PATH_INFO: `/v3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:31.323215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 771/1514] 10.222.0.73 () {54 vars in 925 bytes} [Thu Aug 25 02:58:31 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 02:58:31.329386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9c03-367a-40f9-ba55-1e786907d209 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:31.329819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9c03-367a-40f9-ba55-1e786907d209 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:31.329949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a8c9c03-367a-40f9-ba55-1e786907d209 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:31.390109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5a8c9c03-367a-40f9-ba55-1e786907d209 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:31.391296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a8c9c03-367a-40f9-ba55-1e786907d209 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:31.457172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:31.463297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 744/1515] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Aug 25 02:58:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:31.646747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5989-e0ff-466a-9097-cfafc8807bd2 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:31.647033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5989-e0ff-466a-9097-cfafc8807bd2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:31.647337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55c5989-e0ff-466a-9097-cfafc8807bd2 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:31.648773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 772/1516] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:58:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 02:58:31.655227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09511c-f9aa-4540-97fe-68d0bcb62eb3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:31.655520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09511c-f9aa-4540-97fe-68d0bcb62eb3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:31.655799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de09511c-f9aa-4540-97fe-68d0bcb62eb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:31.677447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-de09511c-f9aa-4540-97fe-68d0bcb62eb3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:31.678648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-de09511c-f9aa-4540-97fe-68d0bcb62eb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:31.687131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 745/1517] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:58:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:31.841266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5989-e0ff-466a-9097-cfafc8807bd2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:31.855393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55c5989-e0ff-466a-9097-cfafc8807bd2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:31.860604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add6b268-2f18-4db5-8103-bda9149c7646 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:31.861184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6b268-2f18-4db5-8103-bda9149c7646 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:31.861459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6b268-2f18-4db5-8103-bda9149c7646 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:31.861725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add6b268-2f18-4db5-8103-bda9149c7646 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:31.869506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6b268-2f18-4db5-8103-bda9149c7646 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:31.871674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add6b268-2f18-4db5-8103-bda9149c7646 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:31.880818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 773/1518] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:40.394519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce77a-18cb-46b7-bd6d-c92c01c52d76 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:40.395044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce77a-18cb-46b7-bd6d-c92c01c52d76 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:40.395173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdce77a-18cb-46b7-bd6d-c92c01c52d76 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:40.396462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 746/1519] 10.222.0.72 () {54 vars in 961 bytes} [Thu Aug 25 02:58:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:40.401589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c8fe-2e30-42cd-b139-37b758dd5466 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:40.402017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c8fe-2e30-42cd-b139-37b758dd5466 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:40.402181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d459c8fe-2e30-42cd-b139-37b758dd5466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:40.421328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d459c8fe-2e30-42cd-b139-37b758dd5466 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:40.422510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d459c8fe-2e30-42cd-b139-37b758dd5466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:40.430832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 774/1520] 10.222.0.72 () {58 vars in 1058 bytes} [Thu Aug 25 02:58:40 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:40.439033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdce77a-18cb-46b7-bd6d-c92c01c52d76 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:40.452525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdce77a-18cb-46b7-bd6d-c92c01c52d76 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:40.457412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e4c175-2a9b-4ba8-b2bb-f127b035075c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:40.458027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c175-2a9b-4ba8-b2bb-f127b035075c service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:40.458307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c175-2a9b-4ba8-b2bb-f127b035075c service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:40.458584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e4c175-2a9b-4ba8-b2bb-f127b035075c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:40.467008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4c175-2a9b-4ba8-b2bb-f127b035075c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:40.468681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e4c175-2a9b-4ba8-b2bb-f127b035075c service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:40.478163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 747/1521] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:40 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:43.091761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd83998-e91e-47df-8d1b-a874f853f6ec None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:43.092446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd83998-e91e-47df-8d1b-a874f853f6ec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:43.092446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd83998-e91e-47df-8d1b-a874f853f6ec None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:43.093679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:58:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:43.098545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b73bd9-2971-4f63-bbf0-cc198ecdd267 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:43.098943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b73bd9-2971-4f63-bbf0-cc198ecdd267 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:43.099104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b73bd9-2971-4f63-bbf0-cc198ecdd267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:43.118227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-58b73bd9-2971-4f63-bbf0-cc198ecdd267 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:43.119419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58b73bd9-2971-4f63-bbf0-cc198ecdd267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:43.127234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:58:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:43.280995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd83998-e91e-47df-8d1b-a874f853f6ec None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:43.295963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd83998-e91e-47df-8d1b-a874f853f6ec None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:43.301332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ec8c4d-256c-432e-ba4e-571e3046a491 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:43.301918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8c4d-256c-432e-ba4e-571e3046a491 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:43.302196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8c4d-256c-432e-ba4e-571e3046a491 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:43.302467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ec8c4d-256c-432e-ba4e-571e3046a491 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:43.311104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec8c4d-256c-432e-ba4e-571e3046a491 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:43.312737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ec8c4d-256c-432e-ba4e-571e3046a491 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:43.321872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 776/1524] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:44.142491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8a6e-71cc-449a-98b7-3ba1143fd670 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:44.143042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8a6e-71cc-449a-98b7-3ba1143fd670 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:44.143042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-007a8a6e-71cc-449a-98b7-3ba1143fd670 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:44.144422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu Aug 25 02:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:44.149277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dc01c-98f6-47f9-b337-20375b263cfb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:44.149714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dc01c-98f6-47f9-b337-20375b263cfb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:44.149818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8dc01c-98f6-47f9-b337-20375b263cfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:44.170379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bb8dc01c-98f6-47f9-b337-20375b263cfb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:44.171582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bb8dc01c-98f6-47f9-b337-20375b263cfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:44.179530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu Aug 25 02:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:44.333503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8a6e-71cc-449a-98b7-3ba1143fd670 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:44.348623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-007a8a6e-71cc-449a-98b7-3ba1143fd670 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:44.353963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a388fef6-a668-4052-81e3-3a1d3ef09cef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:44.355118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388fef6-a668-4052-81e3-3a1d3ef09cef service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:44.355493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388fef6-a668-4052-81e3-3a1d3ef09cef service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:44.355771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a388fef6-a668-4052-81e3-3a1d3ef09cef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:44.363925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388fef6-a668-4052-81e3-3a1d3ef09cef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:44.365527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a388fef6-a668-4052-81e3-3a1d3ef09cef service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:44.374872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 750/1527] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:48.813527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f932-073e-4014-897b-758820987662 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:48.814100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f932-073e-4014-897b-758820987662 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:48.814100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6955f932-073e-4014-897b-758820987662 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:48.815411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:58:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:48.820640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c9b09-6c25-4181-ab97-817cc77769d3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:48.821038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c9b09-6c25-4181-ab97-817cc77769d3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:48.821180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4c9b09-6c25-4181-ab97-817cc77769d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:48.840181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3a4c9b09-6c25-4181-ab97-817cc77769d3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:48.841358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3a4c9b09-6c25-4181-ab97-817cc77769d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:48.849134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:58:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:49.147496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f932-073e-4014-897b-758820987662 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:49.149221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6955f932-073e-4014-897b-758820987662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:49.182517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:58:49.230125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6955f932-073e-4014-897b-758820987662 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:49.233809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1c8279-4c50-4ea2-a110-edf5c67ef5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:49.234411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8279-4c50-4ea2-a110-edf5c67ef5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:49.234689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8279-4c50-4ea2-a110-edf5c67ef5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:49.234961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1c8279-4c50-4ea2-a110-edf5c67ef5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:49.243721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c8279-4c50-4ea2-a110-edf5c67ef5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:49.245315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1c8279-4c50-4ea2-a110-edf5c67ef5b2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:49.254649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 779/1530] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:51.159596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3251c9-24f0-4570-b06c-2798e664a790 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:51.160098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3251c9-24f0-4570-b06c-2798e664a790 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:51.160220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3251c9-24f0-4570-b06c-2798e664a790 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:51.161536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:58:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:51.167750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7127f-0f1e-4850-b13a-bfee7f48d3fa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:51.168198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7127f-0f1e-4850-b13a-bfee7f48d3fa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:51.168389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d7127f-0f1e-4850-b13a-bfee7f48d3fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:51.187605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-45d7127f-0f1e-4850-b13a-bfee7f48d3fa None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:51.188962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45d7127f-0f1e-4850-b13a-bfee7f48d3fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:51.198026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:51.485238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3251c9-24f0-4570-b06c-2798e664a790 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:51.497178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3251c9-24f0-4570-b06c-2798e664a790 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:51.500669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43fd86cf-240d-4e6e-b095-285b0619cf22 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:51.501260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd86cf-240d-4e6e-b095-285b0619cf22 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:51.501562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd86cf-240d-4e6e-b095-285b0619cf22 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:51.501829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fd86cf-240d-4e6e-b095-285b0619cf22 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:51.511355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd86cf-240d-4e6e-b095-285b0619cf22 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:51.512797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43fd86cf-240d-4e6e-b095-285b0619cf22 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:51.521913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 753/1533] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:55.059712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089009-b494-430f-a16d-9b2057d06813 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:55.060266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089009-b494-430f-a16d-9b2057d06813 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:55.060266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9089009-b494-430f-a16d-9b2057d06813 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:55.061629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:55.066956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca8386-4fcf-4a38-b46e-870b3d08822d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:55.067343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca8386-4fcf-4a38-b46e-870b3d08822d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:55.067495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ca8386-4fcf-4a38-b46e-870b3d08822d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:55.086907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-58ca8386-4fcf-4a38-b46e-870b3d08822d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:55.088222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58ca8386-4fcf-4a38-b46e-870b3d08822d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:55.095933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:58:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 02:58:55.656367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9089009-b494-430f-a16d-9b2057d06813 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:55.658034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f9089009-b494-430f-a16d-9b2057d06813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:55.735945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9089009-b494-430f-a16d-9b2057d06813 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:55.739402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f845edb-fb3d-44b4-9d08-c46d92819a9c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:55.740003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845edb-fb3d-44b4-9d08-c46d92819a9c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:55.740305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845edb-fb3d-44b4-9d08-c46d92819a9c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:55.740577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f845edb-fb3d-44b4-9d08-c46d92819a9c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:55.749402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f845edb-fb3d-44b4-9d08-c46d92819a9c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:55.750824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f845edb-fb3d-44b4-9d08-c46d92819a9c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:55.760390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 782/1536] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:58:57.694943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071463b8-329e-4329-9baf-5c9bef8870b1 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:57.695505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071463b8-329e-4329-9baf-5c9bef8870b1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:57.695505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071463b8-329e-4329-9baf-5c9bef8870b1 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:57.696879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 917 bytes} [Thu Aug 25 02:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 02:58:57.702643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f740-1a1f-4510-b36a-ef5d5a78e14c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:57.703051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f740-1a1f-4510-b36a-ef5d5a78e14c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:57.703170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970f740-1a1f-4510-b36a-ef5d5a78e14c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:57.722734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1970f740-1a1f-4510-b36a-ef5d5a78e14c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 02:58:57.723855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1970f740-1a1f-4510-b36a-ef5d5a78e14c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:57.731672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Thu Aug 25 02:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 02:58:58.281096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071463b8-329e-4329-9baf-5c9bef8870b1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 02:58:58.282776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-071463b8-329e-4329-9baf-5c9bef8870b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 02:58:58.296185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071463b8-329e-4329-9baf-5c9bef8870b1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 02:58:58.299641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02eadbff-bfee-4e2b-ac4d-14224a69b5fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 02:58:58.300260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadbff-bfee-4e2b-ac4d-14224a69b5fc service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 02:58:58.300538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadbff-bfee-4e2b-ac4d-14224a69b5fc service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 02:58:58.300807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02eadbff-bfee-4e2b-ac4d-14224a69b5fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 02:58:58.310330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eadbff-bfee-4e2b-ac4d-14224a69b5fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 02:58:58.311730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02eadbff-bfee-4e2b-ac4d-14224a69b5fc service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 02:58:58.321070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 756/1539] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 02:58:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 02:59:07.718186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=63 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 02:59:08.316799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=37 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:27.267739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.268397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.268552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.293827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.295420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.309618 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 784/1540] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.319421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.320036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.320036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.350141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.351356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.364182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 757/1541] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.369434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.389387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8319b7-5400-4e4d-a4da-dcea6b493bbf None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.395646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.396587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.397101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.397645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.398661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:27.399181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.401806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.421085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 785/1542] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:27.429591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.447550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1a8c13-29d8-4604-b0d6-a2071560e301 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.456753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68502ddf-d383-4509-bcac-e0fe141ac4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.457406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502ddf-d383-4509-bcac-e0fe141ac4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.457689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502ddf-d383-4509-bcac-e0fe141ac4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.457966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68502ddf-d383-4509-bcac-e0fe141ac4b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.458634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502ddf-d383-4509-bcac-e0fe141ac4b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.460713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68502ddf-d383-4509-bcac-e0fe141ac4b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.527666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 758/1543] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/projects => generated 383 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:27.532099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.549723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57eea7f-e48a-46aa-b4b3-9721faeb2dee admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.576237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a16df-b423-49db-b651-d90bf758c4d0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.576583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a16df-b423-49db-b651-d90bf758c4d0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.576799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628a16df-b423-49db-b651-d90bf758c4d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.615188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-628a16df-b423-49db-b651-d90bf758c4d0 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.617070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-628a16df-b423-49db-b651-d90bf758c4d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.664558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd5e354-9ce8-4c6f-a464-ef135eced296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.665796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e354-9ce8-4c6f-a464-ef135eced296 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.666150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e354-9ce8-4c6f-a464-ef135eced296 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.666611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd5e354-9ce8-4c6f-a464-ef135eced296 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.667253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5e354-9ce8-4c6f-a464-ef135eced296 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.669247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd5e354-9ce8-4c6f-a464-ef135eced296 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.696818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 786/1544] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/users => generated 292 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:27.698178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50178-fb26-4622-92d8-da60d53a442c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.698469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50178-fb26-4622-92d8-da60d53a442c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.698746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d50178-fb26-4622-92d8-da60d53a442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.709491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 759/1545] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.711192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f745ea-ab53-4d97-aad5-f4a8b6830b5f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.711489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f745ea-ab53-4d97-aad5-f4a8b6830b5f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.711769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f745ea-ab53-4d97-aad5-f4a8b6830b5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.729196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d1d50178-fb26-4622-92d8-da60d53a442c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.731311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1d50178-fb26-4622-92d8-da60d53a442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.735862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-57f745ea-ab53-4d97-aad5-f4a8b6830b5f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.737080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57f745ea-ab53-4d97-aad5-f4a8b6830b5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.740357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 787/1546] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.741589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.741871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.742248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.747661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 760/1547] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.749233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66714-9cd5-4554-9cc0-92383409e991 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.749905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66714-9cd5-4554-9cc0-92383409e991 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.750039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce66714-9cd5-4554-9cc0-92383409e991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.765541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.767834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.777560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6ce66714-9cd5-4554-9cc0-92383409e991 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.778693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6ce66714-9cd5-4554-9cc0-92383409e991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.778832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 788/1548] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.779679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.788186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 761/1549] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.789528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48908-965c-4243-a297-c821a6ba9d78 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.789819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48908-965c-4243-a297-c821a6ba9d78 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.790301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe48908-965c-4243-a297-c821a6ba9d78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.793481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404bceac-08a6-420a-b8b0-ca099a896eec None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.798250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3fbd659-b0b2-47ac-8d72-ba6d9e054eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.798884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbd659-b0b2-47ac-8d72-ba6d9e054eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.799160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbd659-b0b2-47ac-8d72-ba6d9e054eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.799434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3fbd659-b0b2-47ac-8d72-ba6d9e054eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.800112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbd659-b0b2-47ac-8d72-ba6d9e054eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.801728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3fbd659-b0b2-47ac-8d72-ba6d9e054eb6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.809530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8fe48908-965c-4243-a297-c821a6ba9d78 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.810729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8fe48908-965c-4243-a297-c821a6ba9d78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.812262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 789/1550] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:27.813478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646ede-d031-422f-a7db-5dc1e7def0c9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.813757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646ede-d031-422f-a7db-5dc1e7def0c9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.814029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce646ede-d031-422f-a7db-5dc1e7def0c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.820577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 762/1551] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.822587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7cc1e-8328-405f-9eaa-bea42d6cdfc6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.822958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7cc1e-8328-405f-9eaa-bea42d6cdfc6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.823237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac7cc1e-8328-405f-9eaa-bea42d6cdfc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.835780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ce646ede-d031-422f-a7db-5dc1e7def0c9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.837607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ce646ede-d031-422f-a7db-5dc1e7def0c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.843121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9ac7cc1e-8328-405f-9eaa-bea42d6cdfc6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.844320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9ac7cc1e-8328-405f-9eaa-bea42d6cdfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.845581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 790/1552] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.849320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c203440-c86b-4f8c-a711-669640d49f72 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.849320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c203440-c86b-4f8c-a711-669640d49f72 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.849320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c203440-c86b-4f8c-a711-669640d49f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.859558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 763/1553] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.859558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20208c99-0937-40d3-9b9e-c08d6bad1ef1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.859558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20208c99-0937-40d3-9b9e-c08d6bad1ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.859558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20208c99-0937-40d3-9b9e-c08d6bad1ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.866765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0c203440-c86b-4f8c-a711-669640d49f72 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.867966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0c203440-c86b-4f8c-a711-669640d49f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.874128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20208c99-0937-40d3-9b9e-c08d6bad1ef1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.875296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20208c99-0937-40d3-9b9e-c08d6bad1ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.876833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 791/1554] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.878016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.878294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.878564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.887483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 764/1555] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.888741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.889025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.889369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.898194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.899447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.907315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 792/1556] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.908112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.909294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.910466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.917518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52be2899-c76a-4d0c-a8aa-f83bc4c5177c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.918794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 765/1557] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.919587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.922726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.923322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.923598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.923865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.924726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.926307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.928746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57027258-cdd4-4ccb-9a8c-a5624d92e557 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.934241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.934776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.935071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.935327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.935965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:27.936296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.940343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 793/1558] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:27.941052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:00:27.941052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 03:00:27.941052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 03:00:27.941320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.941437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed6ef30-6f2f-4ec4-b74a-78812aeab984 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.951098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 766/1559] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:27.952502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ba61b-cff0-4ed3-8716-387cdb1c833d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.952921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ba61b-cff0-4ed3-8716-387cdb1c833d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.953202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484ba61b-cff0-4ed3-8716-387cdb1c833d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.954485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4367f1cf-c2cb-403c-bc7e-8ec8ea75fe03 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.959333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.959927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.960257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.960531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.961165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:27.961459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.963774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:27.973165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-484ba61b-cff0-4ed3-8716-387cdb1c833d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:27.974368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-484ba61b-cff0-4ed3-8716-387cdb1c833d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:27.975660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 794/1560] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:27.976624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:27.986934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc880c9f-bc82-4685-92ca-c8404c0b408f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:27.987752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 767/1561] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:27.988991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.989272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.989545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.995251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:27.995839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:27.996143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:27.996413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:27.997048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:27.997343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:27.998910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.008707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:28.010628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:28.011327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 795/1562] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:28.012305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.019105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 768/1563] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:28.019885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.025525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ddd890-a6b1-4367-a076-25393cf0cdf6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.030141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4646ec10-c2c8-4534-8dbc-6a0ad5ddc147 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.030536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.031130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.031406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.031678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.032365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:28.032799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.034378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.034969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.035561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.035841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.036137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.036770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:28.037066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.038662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.047038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 796/1564] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:28.047824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.058233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87456987-c20e-43d9-80cf-f8534ee33967 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.059691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 769/1565] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:28.060603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.062781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.063426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.063702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.064133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] PATH_INFO: `/v3/projects/859b84acfc89473aabe2c2737b68a3a0/users/e8787ae5e89f4d8aa44497e9afc3d186/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.070899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3940f3c2-07f1-47e6-a5da-bc4b8e63e3e8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.076248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.076844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.077132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.077409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.078027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.079408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=859b84acfc89473aabe2c2737b68a3a0, user_id=e8787ae5e89f4d8aa44497e9afc3d186, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.079920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.080455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:00:28.080455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 03:00:28.080455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 03:00:28.082345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.096072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 797/1566] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:28 2022] PUT /identity/v3/projects/859b84acfc89473aabe2c2737b68a3a0/users/e8787ae5e89f4d8aa44497e9afc3d186/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:28.097078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.112327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 770/1567] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.112327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.119340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.140285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.175246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a6568a-8a9c-4a02-8ddd-67f5c47227c0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.178449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59647432-0dad-4053-b431-63630e1304b5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.180134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.180763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.181139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.181456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.181973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.182983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:00:28.182983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 03:00:28.182983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 03:00:28.183854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.184185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.184489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.184774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.185079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.185748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:28.186052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.187627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.201019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 771/1568] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:28.201814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.211648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba29a1b-8a19-4e88-b6fb-4fe9db400993 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.216970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.217737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.218208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.218480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 798/1569] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 373 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.218583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.219221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.219320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.221542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.250901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 772/1570] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.251982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.286633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3818be96-00b5-4b62-b1d3-6b8597dc00e7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.315032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad5d62b-d3c1-4c21-bee6-610129d91c95 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.319605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.320224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.320505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.320777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.321963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.323861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.343284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.344361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.344623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.344923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.345624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:28.345944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.347536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3b8629-caae-43d0-96f0-92baaa1e5f1c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.354953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 773/1571] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 389 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.354953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.360081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 799/1572] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:28.361316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.361599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.361874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.390421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] MFA Rules not processed for user `e8787ae5e89f4d8aa44497e9afc3d186`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:28.391635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:28.420412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.425019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d84de07-330f-468d-bec3-1b0204ab1ec5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.430124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.430459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.430671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.430919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.431540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.433544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.461251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 774/1573] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 403 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.462852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.466468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 800/1574] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:28.467617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.469568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.479020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e241aedc-dd74-4ac6-aa4f-5a17a8940b8c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.529889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33bea768-0892-4765-bc90-c9d8dada919c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.534862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.535466 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.535742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.536010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.536731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.537800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:00:28.537800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 03:00:28.537800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 03:00:28.538999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.544868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.545472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.545746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.546015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.546627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.548543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.560384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 775/1575] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.561182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.571060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf7df4b8-aa7d-43fd-9ed7-714345158d4a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.576416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.577018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.577296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.577571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.578192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.578700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 801/1576] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 391 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.581986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.582091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.604944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 776/1577] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 287 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.604944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.612682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912925-3268-4e61-abbe-5e9b29d29237 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.643125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2728208-72ad-4dd7-a83a-dde7637922f1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.647748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.648378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.648653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.648917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.649703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.651738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.671627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.671868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 802/1578] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.672684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.672799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.673019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.673231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.673882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.675911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.684441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6efa2b-af56-498d-b089-a8fcc5fbad2a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.689377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1df04-df58-40e0-859f-863485a4b3f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.690078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1df04-df58-40e0-859f-863485a4b3f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.690370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1df04-df58-40e0-859f-863485a4b3f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.690680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1df04-df58-40e0-859f-863485a4b3f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.691369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1df04-df58-40e0-859f-863485a4b3f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.693448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1df04-df58-40e0-859f-863485a4b3f5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.699679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 777/1579] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 295 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.700783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.715507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d9f0c8-8540-45c7-8083-62aed252cfeb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.720324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.721094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.721525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.721807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.722431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.724344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.730526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 803/1580] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.730526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e775dbf-0c4f-4d12-83b1-265ba143a919 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.730526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e775dbf-0c4f-4d12-83b1-265ba143a919 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.730526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e775dbf-0c4f-4d12-83b1-265ba143a919 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.731554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 804/1581] 10.222.0.72 () {54 vars in 962 bytes} [Thu Aug 25 03:00:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:28.732304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e775dbf-0c4f-4d12-83b1-265ba143a919 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.752292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 778/1582] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 302 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.752292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.760733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538e4bf-d5fc-4857-a9c8-41de1cfe1295 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.761656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.807971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:28.808576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e775dbf-0c4f-4d12-83b1-265ba143a919 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.814048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.814655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.814935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.815200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.815841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.817463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.821079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.822316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.822658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.822939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.823711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.825660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.828392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 805/1583] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:28.828984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.838393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd8fc83-7689-4eee-99ca-5182c68c163e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.843283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.843899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.844212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.844499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.845190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.846687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.848368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 779/1584] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.849039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.859403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2de87f4-6c34-413e-ac3c-f2097580c704 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.862796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 806/1585] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:28.862796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.867132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.867744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.868021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.868860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.869722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.871311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.871422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430eb602-d1d2-4ccb-a276-bfb0d0461a38 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.876116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7f3b3-2610-4428-8ecd-013a0e04743b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.876775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7f3b3-2610-4428-8ecd-013a0e04743b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.877125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7f3b3-2610-4428-8ecd-013a0e04743b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.877395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7f3b3-2610-4428-8ecd-013a0e04743b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.878052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7f3b3-2610-4428-8ecd-013a0e04743b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.879646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7f3b3-2610-4428-8ecd-013a0e04743b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.885548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 780/1586] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:28.885548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.892599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1925e7-2c2a-440a-a3df-0527f51aebf4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.896847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 807/1587] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:28.896847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.896847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.896847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.897339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.897958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.898241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.898512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.899145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.901422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.928320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 781/1588] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/users => generated 289 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:28.928320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.939584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebbb2bc-c5d8-4c93-b12d-feeecc59a7f8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.941197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:28.942482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:28.943986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.944754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.945032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.945302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.945945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.948259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.959148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 782/1589] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:28.959957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:28.969944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8771c1cd-9a22-4353-ae5e-4756b9a57dbb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:28.974920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:28.975515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:28.975911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:28.976112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:28.976757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:28.979306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:28.992525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 783/1590] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:28.994057 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.003954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151077cc-3f46-4ec1-988e-78b7e634ea00 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.008937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.009839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.010127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.010405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.011034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.012722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.017346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 808/1591] 10.222.0.72 () {58 vars in 1059 bytes} [Thu Aug 25 03:00:28 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.018210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.028179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 784/1592] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.028179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.029017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6694924-7e14-4f54-9c0f-91e48ef2d90a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.033595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.034204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.034486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.034760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.035411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.037029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.037250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247443fa-0d7c-446c-8a8a-256e872835e4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.042764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.043352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.043634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.043916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.044591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.046162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.051240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 809/1593] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.051240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.060894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 785/1594] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.060894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.061133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b984b186-88bb-49ec-afe2-d8bea175bc62 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.064290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.064878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.065153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.065426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.066058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.067630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.068121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe5aecc-0fc1-4e74-ace9-11749a04bdbb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.073768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.074353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.074637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.074916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.075547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.077158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.077805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 810/1595] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.078588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.087873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75645a67-bde8-4a7b-a488-8cf3473aec43 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.093217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.093769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.093936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 786/1596] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.094049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.094252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.094903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.095364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.096535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.107013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a8f72-abb2-4f8e-965b-f195a723c613 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.110268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 811/1597] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.110268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.114459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.115213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.115560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.115939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] PATH_INFO: `/v3/projects/5b1e21570e6f482591c0d2153d3e8783/users/9829dc5be66f486c9e843cf9166a874e/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.123754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c792c423-5029-45a2-844f-bf1a0c9718d3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.128267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.128857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.129578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.129578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.130267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.131857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.136964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=5b1e21570e6f482591c0d2153d3e8783, user_id=9829dc5be66f486c9e843cf9166a874e, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.139605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.142274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 812/1598] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.143139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.158590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853045d1-6c09-4794-82da-539553a556a1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.158970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 787/1599] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/5b1e21570e6f482591c0d2153d3e8783/users/9829dc5be66f486c9e843cf9166a874e/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.159897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.192278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.229149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1481ff96-5d4d-4b2f-b4ca-cebe5dbcd4dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.231031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.231644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.231919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.232219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.233803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.234458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.234734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.235004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] PATH_INFO: `/v3/projects/96612f5a9841489aab25ff07556b2dcd/users/44452c76ce394aaabde1414316ae7542/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.250905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96612f5a9841489aab25ff07556b2dcd, user_id=44452c76ce394aaabde1414316ae7542, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.253565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.268442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 788/1600] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/96612f5a9841489aab25ff07556b2dcd/users/44452c76ce394aaabde1414316ae7542/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.269342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.283407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.297887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.299479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.309113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 813/1601] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:29.309798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.320411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04131020-3443-498b-b4c8-071699a76f7c service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.334342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da08f40e-86e3-419e-8d31-b71bdfe98096 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.339871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.340762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.341092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.341435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] PATH_INFO: `/v3/projects/03baaeceae1143ccb6835e328276af6b/users/b0af05c9e23544739eee8f6f804e8db1/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.357324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03baaeceae1143ccb6835e328276af6b, user_id=b0af05c9e23544739eee8f6f804e8db1, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.360021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.374824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 789/1602] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/03baaeceae1143ccb6835e328276af6b/users/b0af05c9e23544739eee8f6f804e8db1/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.375883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.394930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.396142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.396501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.396848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] PATH_INFO: `/v3/projects/3f0976be663b4253bd8a392d40236df2/users/ce7b1f7925614a2b9cf9d2c7eaf2b7f7/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.414754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f0976be663b4253bd8a392d40236df2, user_id=ce7b1f7925614a2b9cf9d2c7eaf2b7f7, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.417982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.433633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 814/1603] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/3f0976be663b4253bd8a392d40236df2/users/ce7b1f7925614a2b9cf9d2c7eaf2b7f7/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.434732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.442788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca699ce-4389-403f-b407-0fd0d000331f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.490516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.501957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.502685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.502852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.503153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.503886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.505783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.506584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847049d0-887d-4f28-9215-b64959367f69 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.513234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba78a20-9e76-431a-9035-3795b1e5824a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.513885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78a20-9e76-431a-9035-3795b1e5824a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.514169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78a20-9e76-431a-9035-3795b1e5824a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.514428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba78a20-9e76-431a-9035-3795b1e5824a admin admin] PATH_INFO: `/v3/projects/47fabb201b0344cfa6b88a7b99e7367b/users/75fee0c032e9415dbaf63fe4383333f0/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.516871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 790/1604] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:29 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:29.520869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.531002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06147d4-5771-4c48-a9a3-b99c86a3df74 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.535562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78a20-9e76-431a-9035-3795b1e5824a admin admin] RBAC: Authorizing `identity:create_grant(project_id=47fabb201b0344cfa6b88a7b99e7367b, user_id=75fee0c032e9415dbaf63fe4383333f0, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.535800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3aa6e6d-dfe8-4c5f-9817-fc201e7bf229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.536480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6e6d-dfe8-4c5f-9817-fc201e7bf229 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.536766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6e6d-dfe8-4c5f-9817-fc201e7bf229 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.537048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3aa6e6d-dfe8-4c5f-9817-fc201e7bf229 admin admin] PATH_INFO: `/v3/projects/c38e2834ce6f4835a53d1f099307d36d/users/67d1de462c2a40be909e32e1846d77ca/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.538214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba78a20-9e76-431a-9035-3795b1e5824a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.552651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 815/1605] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/47fabb201b0344cfa6b88a7b99e7367b/users/75fee0c032e9415dbaf63fe4383333f0/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.564165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6e6d-dfe8-4c5f-9817-fc201e7bf229 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c38e2834ce6f4835a53d1f099307d36d, user_id=67d1de462c2a40be909e32e1846d77ca, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.564291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac23a3-a113-4d14-98de-d7b4a0fcf3f2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.564291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac23a3-a113-4d14-98de-d7b4a0fcf3f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.564291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac23a3-a113-4d14-98de-d7b4a0fcf3f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.564562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3aa6e6d-dfe8-4c5f-9817-fc201e7bf229 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.574958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 791/1606] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/c38e2834ce6f4835a53d1f099307d36d/users/67d1de462c2a40be909e32e1846d77ca/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.576252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d559bb-1ca3-4adf-96f6-bf57f3c5b4d8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.576601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d559bb-1ca3-4adf-96f6-bf57f3c5b4d8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.577932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d559bb-1ca3-4adf-96f6-bf57f3c5b4d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.585516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-08ac23a3-a113-4d14-98de-d7b4a0fcf3f2 None None] MFA Rules not processed for user `9829dc5be66f486c9e843cf9166a874e`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.586765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-08ac23a3-a113-4d14-98de-d7b4a0fcf3f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.604469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-61d559bb-1ca3-4adf-96f6-bf57f3c5b4d8 None None] MFA Rules not processed for user `44452c76ce394aaabde1414316ae7542`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.605652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-61d559bb-1ca3-4adf-96f6-bf57f3c5b4d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.609524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.653159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 816/1607] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.654446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.654736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.655009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.680083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 792/1608] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.680083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380169e-3552-4991-94a8-cbb3ec23f9cd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.680083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380169e-3552-4991-94a8-cbb3ec23f9cd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.680083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d380169e-3552-4991-94a8-cbb3ec23f9cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.682657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] MFA Rules not processed for user `b0af05c9e23544739eee8f6f804e8db1`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.683948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.700416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d380169e-3552-4991-94a8-cbb3ec23f9cd None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.701624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d380169e-3552-4991-94a8-cbb3ec23f9cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.753750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 817/1609] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.753750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.763822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 793/1610] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.765517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce92d-ea11-46b9-957b-fb2d2d066b88 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.765867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce92d-ea11-46b9-957b-fb2d2d066b88 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.766211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbce92d-ea11-46b9-957b-fb2d2d066b88 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.772061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 794/1611] 10.222.0.72 () {54 vars in 912 bytes} [Thu Aug 25 03:00:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:29.773722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.774247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.774816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.804601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] MFA Rules not processed for user `75fee0c032e9415dbaf63fe4383333f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.806398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.811003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.825450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbe6573-cd66-4113-bb1c-78f3c9a88eba None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.829911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3af6224-8a44-4cf3-a3cf-63c641fcb93c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.830565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af6224-8a44-4cf3-a3cf-63c641fcb93c admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.830840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af6224-8a44-4cf3-a3cf-63c641fcb93c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.831108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3af6224-8a44-4cf3-a3cf-63c641fcb93c admin admin] PATH_INFO: `/v3/projects/c790d9e7de1e4009ae066086d2ee085b/users/2a0b55bf8f614a948f2cbd684f8faca3/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.845790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af6224-8a44-4cf3-a3cf-63c641fcb93c admin admin] RBAC: Authorizing `identity:create_grant(project_id=c790d9e7de1e4009ae066086d2ee085b, user_id=2a0b55bf8f614a948f2cbd684f8faca3, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.848660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3af6224-8a44-4cf3-a3cf-63c641fcb93c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.863044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 818/1612] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:29 2022] PUT /identity/v3/projects/c790d9e7de1e4009ae066086d2ee085b/users/2a0b55bf8f614a948f2cbd684f8faca3/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:29.864377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.864734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.865075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.872985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 795/1613] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.873986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.884919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:29.885077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3438c82-4989-45b4-9a5d-93ac39196fa4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.886136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:29.918322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:29.949735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d4a980-e3dc-4853-9495-2eb9d07c4722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.950362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a980-e3dc-4853-9495-2eb9d07c4722 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.950640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a980-e3dc-4853-9495-2eb9d07c4722 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.950913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d4a980-e3dc-4853-9495-2eb9d07c4722 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.951546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4a980-e3dc-4853-9495-2eb9d07c4722 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.953196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 819/1614] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:29.953658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d4a980-e3dc-4853-9495-2eb9d07c4722 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.954091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:29.968430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d263a1cc-9f79-48fe-b81d-a7c48053d3db None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:29.973574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:29.974204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.974488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.974791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:29.975451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:29.978007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:29.985255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 796/1615] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:29.985255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365a50-81a1-40b4-b115-2077c6baed7e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:29.985255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365a50-81a1-40b4-b115-2077c6baed7e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:29.985255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365a50-81a1-40b4-b115-2077c6baed7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.005367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b8365a50-81a1-40b4-b115-2077c6baed7e None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:30.006471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 820/1616] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:30.010030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8365a50-81a1-40b4-b115-2077c6baed7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:30.010129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.063605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8956d90d-25b5-4942-a2b6-c0a76bb5c0ef admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.067399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.067999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.068309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.068580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.074660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 797/1617] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:29 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:30.075960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f345145-cd09-491d-8abf-f6e9267e3fb9 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.076218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f345145-cd09-491d-8abf-f6e9267e3fb9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.076561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f345145-cd09-491d-8abf-f6e9267e3fb9 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.077949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 798/1618] 10.222.0.72 () {54 vars in 962 bytes} [Thu Aug 25 03:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:30.078789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.079069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.079342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.100957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:30.102147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:30.134383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.135827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.145426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 821/1619] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:30.148028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.153203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.158622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebdccac-14cb-4889-9e62-e2c8070e0646 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.166217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 799/1620] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:30.166372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.166880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.170064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.170172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.170430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.171209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.173349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.180911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff461b27-8f7c-4fce-918f-6455a324079e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.186809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.187741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.188249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.188533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.200947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.202484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.206837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 822/1621] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:30 2022] POST /identity/v3/projects => generated 405 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:30.208974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.214626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 800/1622] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:30.215502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.229215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee315b37-afce-4f7b-980d-4c7b3ad1e830 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.280462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.300141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993bfe7d-d090-4b53-96bf-27cc8bd259f5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.302742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.303540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.303899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.304271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.304969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.305081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af0b6c6-b984-45fb-84e3-20284d09c2e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.306120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0b6c6-b984-45fb-84e3-20284d09c2e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.306386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0b6c6-b984-45fb-84e3-20284d09c2e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.306659 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af0b6c6-b984-45fb-84e3-20284d09c2e4 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.307396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0b6c6-b984-45fb-84e3-20284d09c2e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.308251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.309873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af0b6c6-b984-45fb-84e3-20284d09c2e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.338111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 823/1623] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:30 2022] POST /identity/v3/users => generated 299 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:30.338332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 801/1624] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:30 2022] POST /identity/v3/users => generated 292 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:30.338332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.338871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.338871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.338871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.359405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:30.360725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:30.407047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7431db-0033-4cb5-b4db-0d746d82c3dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.411017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.411750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.412162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.412539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.438634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 824/1625] 10.222.0.72 () {58 vars in 1059 bytes} [Thu Aug 25 03:00:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:30.439560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.441378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:30.494027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.495519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.506824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01ffd30-9aa4-4135-a660-6f5dbcd88c6c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.509236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 802/1626] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:30.510736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.514024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.514653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.514935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.515210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.522766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aaf98e-a40e-4a47-aab1-a39fe404fd4a service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.525788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.527304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.529824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.530546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.530917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.531577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.532365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.534835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.537988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 825/1627] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:30.538933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.544961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.549239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b86dd5-8e87-475a-a519-222d3f021b41 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.562834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.563672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.563810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.564085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.564730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.566383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.567546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 803/1628] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:30 2022] POST /identity/v3/users => generated 309 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:30.568781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.586406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac927a1-97b0-4df5-89ad-0db4dd1c6226 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.594350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 826/1629] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:30.595493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.599156 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.599956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.600305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.600674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.601387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.604233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.620148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 804/1630] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:30.621206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.624847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb3b3d6-b719-45c1-836d-1623df3f5085 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.634478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f658a4da-29a5-4e58-8590-550dee460337 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.639437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.640219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.640579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.640870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.641907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.643957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.644282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.644914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.645935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.649617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.667518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 805/1631] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:30.668602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.680185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5a92f3-4d40-4d31-a16f-90bcdf9da332 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.687588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.689039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.689441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.689640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] PATH_INFO: `/v3/projects/4591729f03704b90a23cf8e2507de36e/users/ea6f163dc7194bdb8c67fdec53fe224e/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.711633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4591729f03704b90a23cf8e2507de36e, user_id=ea6f163dc7194bdb8c67fdec53fe224e, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.714639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.747191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 806/1632] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:30 2022] PUT /identity/v3/projects/4591729f03704b90a23cf8e2507de36e/users/ea6f163dc7194bdb8c67fdec53fe224e/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:30.748073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.750815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.753067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.771081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:30.780260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 827/1633] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:30.781247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.794194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3de554-f9a4-458e-a579-00f599f4f274 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.883949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.886325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.887236 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.887542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] PATH_INFO: `/v3/projects/722a00f039164480b92e5d887b8c7186/users/1a2fa63c8c954b0d952a3b3f6da5d0aa/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.911905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccf52da-fc52-4552-801d-ed514ce0cf94 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:30.926594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:30.927784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:30.928604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:30.928899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] PATH_INFO: `/v3/projects/cdcee8dd9bf94b7f85cb765be405dac3/users/2f6f31271b42486d880a4302cd8d7496/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:30.939459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=722a00f039164480b92e5d887b8c7186, user_id=1a2fa63c8c954b0d952a3b3f6da5d0aa, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.942783 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.964829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcee8dd9bf94b7f85cb765be405dac3, user_id=2f6f31271b42486d880a4302cd8d7496, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:30.968134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:30.971652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 828/1634] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:30 2022] PUT /identity/v3/projects/722a00f039164480b92e5d887b8c7186/users/1a2fa63c8c954b0d952a3b3f6da5d0aa/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:30.974149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:30.988121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 807/1635] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:30 2022] PUT /identity/v3/projects/cdcee8dd9bf94b7f85cb765be405dac3/users/2f6f31271b42486d880a4302cd8d7496/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:30.989182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.102391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4cf7cc7-2f88-44c3-ad85-76d6edd10f0b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.127871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.128551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.128839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.129212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.129881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.130329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc4961-e1de-4381-b1aa-4d5ca2677e88 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.138535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.145786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.146418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.146750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.147025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.147678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.151352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 829/1636] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:31.151854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.152250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.165031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e683729-5090-4fd1-b6e1-39896556afc0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.175982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 808/1637] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:30 2022] GET /identity/v3/roles => generated 1420 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:31.176581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.177207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.177492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.177771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.178428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.180032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.181360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.188276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.194368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 830/1638] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:31.195416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.204378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb7f019-d26c-47a3-9df4-bac43685f07c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.216354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5641d0-d6e2-4f05-8e43-7f40397db992 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.217074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3545a3ad-c87d-40a1-a168-30f9893afcf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.217742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545a3ad-c87d-40a1-a168-30f9893afcf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.218031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545a3ad-c87d-40a1-a168-30f9893afcf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.218307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3545a3ad-c87d-40a1-a168-30f9893afcf3 admin admin] PATH_INFO: `/v3/projects/4591729f03704b90a23cf8e2507de36e/users/ea6f163dc7194bdb8c67fdec53fe224e/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.220938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545a3ad-c87d-40a1-a168-30f9893afcf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4591729f03704b90a23cf8e2507de36e, user_id=ea6f163dc7194bdb8c67fdec53fe224e, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.224639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.224639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.224639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.225059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3545a3ad-c87d-40a1-a168-30f9893afcf3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.225227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] PATH_INFO: `/v3/projects/722a00f039164480b92e5d887b8c7186/users/1a2fa63c8c954b0d952a3b3f6da5d0aa/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.226537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=722a00f039164480b92e5d887b8c7186, user_id=1a2fa63c8c954b0d952a3b3f6da5d0aa, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.230064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.245687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 831/1639] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:31 2022] PUT /identity/v3/projects/722a00f039164480b92e5d887b8c7186/users/1a2fa63c8c954b0d952a3b3f6da5d0aa/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:31.246692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.269109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 809/1640] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:31 2022] PUT /identity/v3/projects/4591729f03704b90a23cf8e2507de36e/users/ea6f163dc7194bdb8c67fdec53fe224e/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:31.270459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5e53-85b7-4406-a1a1-11fe5756b97d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.270748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5e53-85b7-4406-a1a1-11fe5756b97d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.271018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba5e53-85b7-4406-a1a1-11fe5756b97d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.336085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dbba5e53-85b7-4406-a1a1-11fe5756b97d None None] MFA Rules not processed for user `1a2fa63c8c954b0d952a3b3f6da5d0aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:31.336655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dbba5e53-85b7-4406-a1a1-11fe5756b97d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:31.347581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a412676a-3667-4e39-91d3-0be5e1301f76 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.472599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.482469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c31ce8-1b8f-4db5-9951-604ff723abed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.483153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c31ce8-1b8f-4db5-9951-604ff723abed admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.483432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c31ce8-1b8f-4db5-9951-604ff723abed admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.483722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c31ce8-1b8f-4db5-9951-604ff723abed admin admin] PATH_INFO: `/v3/projects/cdcee8dd9bf94b7f85cb765be405dac3/users/2f6f31271b42486d880a4302cd8d7496/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.493485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 810/1641] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:31 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:31.495208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d670-781a-45c9-a9dd-3bf5434c5c33 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.496283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c31ce8-1b8f-4db5-9951-604ff723abed admin admin] RBAC: Authorizing `identity:create_grant(project_id=cdcee8dd9bf94b7f85cb765be405dac3, user_id=2f6f31271b42486d880a4302cd8d7496, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.497922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d670-781a-45c9-a9dd-3bf5434c5c33 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.498210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac86d670-781a-45c9-a9dd-3bf5434c5c33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.500854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c31ce8-1b8f-4db5-9951-604ff723abed admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.529288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 832/1642] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:31 2022] PUT /identity/v3/projects/cdcee8dd9bf94b7f85cb765be405dac3/users/2f6f31271b42486d880a4302cd8d7496/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:31.530621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3a4e-c9be-40d6-bbef-988c035fb034 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.530906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3a4e-c9be-40d6-bbef-988c035fb034 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.531179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eb3a4e-c9be-40d6-bbef-988c035fb034 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.535684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 833/1643] 10.222.0.72 () {54 vars in 912 bytes} [Thu Aug 25 03:00:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:31.538709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3a4e-c9be-40d6-bbef-988c035fb034 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:31.572194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ac86d670-781a-45c9-a9dd-3bf5434c5c33 None None] MFA Rules not processed for user `ea6f163dc7194bdb8c67fdec53fe224e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:31.589384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac86d670-781a-45c9-a9dd-3bf5434c5c33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:31.678176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 811/1644] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:31 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:31.679703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.680138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.681430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.781777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] MFA Rules not processed for user `2f6f31271b42486d880a4302cd8d7496`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:31.784157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:31.789582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1eb3a4e-c9be-40d6-bbef-988c035fb034 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:31.798654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1be1b96-c344-48f5-99a7-27c63358450c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:31.802639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1b96-c344-48f5-99a7-27c63358450c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:31.803742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1b96-c344-48f5-99a7-27c63358450c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:31.804019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1be1b96-c344-48f5-99a7-27c63358450c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:31.924855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:31.979943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be1b96-c344-48f5-99a7-27c63358450c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:31.982175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1be1b96-c344-48f5-99a7-27c63358450c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:31.997889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 834/1645] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 462 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:31.999559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 812/1646] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:31 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:32.000157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.000401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.000819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.001292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.016165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d5c829-8142-41ea-806b-50a23ad8692b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.027581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:32.030115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:32.038045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.038681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.038965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.040015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.059705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.061668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.088430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 813/1647] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:31 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:32.102147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.129582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dc4810-bdaf-4def-a03d-aefde62fc917 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.152465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.153154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.153436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.153989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.179559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.181951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.219864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 814/1648] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:32.220898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.307623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 835/1649] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:31 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:32.359051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.378756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddfc99c-4e8d-4c93-ac0d-db2e8017b0e7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.384957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.385732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.386677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.387164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.387498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.403843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.405511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.425985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05a1de3-bc6e-49be-b6c6-2cdb35c2422b service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.436403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 836/1650] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:00:32.438583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.439240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.439523 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.439801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] PATH_INFO: `/v3/users/9829dc5be66f486c9e843cf9166a874e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.442111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] RBAC: Authorizing `identity:delete_user(user_id=9829dc5be66f486c9e843cf9166a874e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.445186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.461245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.483250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976343b5-d4cb-40be-a7b7-d23f15ea633a service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.495855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.497029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.497319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.497596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.576950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9829dc5be66f486c9e843cf9166a874e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.578831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.579442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9829dc5be66f486c9e843cf9166a874e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.580317 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.600897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 837/1651] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:32.601722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.625174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39a3b2a-7bec-4eaf-a7f3-a983968f266b service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.636178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.636825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.637105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.637377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] PATH_INFO: `/v3/users/75fee0c032e9415dbaf63fe4383333f0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.638527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=75fee0c032e9415dbaf63fe4383333f0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.639565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: WARNING py.warnings [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:00:32.639565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: warnings.warn(msg) Aug 25 03:00:32.639565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: Aug 25 03:00:32.641968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.644196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9829dc5be66f486c9e843cf9166a874e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.687113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9829dc5be66f486c9e843cf9166a874e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.695894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9829dc5be66f486c9e843cf9166a874e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.716586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 815/1652] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:32 2022] DELETE /identity/v3/users/9829dc5be66f486c9e843cf9166a874e => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:32.717632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:32.726634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:32.817554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75fee0c032e9415dbaf63fe4383333f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.818385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75fee0c032e9415dbaf63fe4383333f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.832403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:32.843141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75fee0c032e9415dbaf63fe4383333f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.862496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75fee0c032e9415dbaf63fe4383333f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.909417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7558eb4-28a0-4e7a-bad0-d5ecf0cbe8a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75fee0c032e9415dbaf63fe4383333f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:32.911344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2985bb-2922-42ea-9e86-3c55641e5a2e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:32.924788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:32.928318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.928608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.928886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] PATH_INFO: `/v3/users/b0af05c9e23544739eee8f6f804e8db1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.937668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 838/1653] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:32 2022] DELETE /identity/v3/users/75fee0c032e9415dbaf63fe4383333f0 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:32.937668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c97e7-9de7-4420-b086-396e42f87607 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:32.937668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c97e7-9de7-4420-b086-396e42f87607 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:32.937668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3c97e7-9de7-4420-b086-396e42f87607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:32.938093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0af05c9e23544739eee8f6f804e8db1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:32.941706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:32.985912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0e3c97e7-9de7-4420-b086-396e42f87607 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:32.987766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0e3c97e7-9de7-4420-b086-396e42f87607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:33.070543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0af05c9e23544739eee8f6f804e8db1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:33.071361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0af05c9e23544739eee8f6f804e8db1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:33.101739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:33.104518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0af05c9e23544739eee8f6f804e8db1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:33.122826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0af05c9e23544739eee8f6f804e8db1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:33.142835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d3f96b16-12dd-480a-81d5-4b7b01ab16eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0af05c9e23544739eee8f6f804e8db1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:33.147495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 839/1654] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:33.153639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.154005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.154402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.157084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 816/1655] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:32 2022] DELETE /identity/v3/users/b0af05c9e23544739eee8f6f804e8db1 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:33.161295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.161472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.161690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.199149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:33.201795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:33.208233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:33.211165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:33.351130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 840/1656] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:33.352664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:33.354753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:33.365250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 817/1657] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:00:33.445935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393dba60-ec3a-4a33-a646-0b01d089843e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:33.454116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.454751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.455137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.455471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.459189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:33.468804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:33.478869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.481302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.483441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ded9a4-1381-4a4f-bba2-4ad0c1fc031e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:33.495127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8c5f91-c66e-4038-aa74-a899e7b05f4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.495850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5f91-c66e-4038-aa74-a899e7b05f4b service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.496155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5f91-c66e-4038-aa74-a899e7b05f4b service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.496428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8c5f91-c66e-4038-aa74-a899e7b05f4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.497893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 841/1658] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:33.498863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:33.511825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cdffa2-dd52-4895-9f8b-253f8f8e3dd0 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:33.516343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:33.517016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:33.517337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:33.517455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c5f91-c66e-4038-aa74-a899e7b05f4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.517669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:33.522787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8c5f91-c66e-4038-aa74-a899e7b05f4b service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.529923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:33.531814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:33.536991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=3,keystone:SELECT=97 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:33.547488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 842/1659] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:33.552780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 818/1660] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:00:34.588565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:34.590555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:34.619925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b535aea-626b-4d2c-9bfb-f2e3475e2019 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:34.638810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:34.639459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:34.645174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:34.645174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] PATH_INFO: `/v3/projects/03baaeceae1143ccb6835e328276af6b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:34.646574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03baaeceae1143ccb6835e328276af6b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:34.648558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:34.767442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03baaeceae1143ccb6835e328276af6b', 'request_id': 'req-66e43f4e-c09e-4571-bfc6-1911b6189cc9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:34.781469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03baaeceae1143ccb6835e328276af6b', 'request_id': 'req-66e43f4e-c09e-4571-bfc6-1911b6189cc9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:34.805898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03baaeceae1143ccb6835e328276af6b', 'request_id': 'req-66e43f4e-c09e-4571-bfc6-1911b6189cc9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:34.824527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] The token cache is being invalidate because project 03baaeceae1143ccb6835e328276af6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:34.825759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:34.831214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:34.833289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 843/1661] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:34 2022] DELETE /identity/v3/projects/03baaeceae1143ccb6835e328276af6b => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:34.838653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fba94-3893-4a7f-8457-f04de13c5af8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:34.839276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fba94-3893-4a7f-8457-f04de13c5af8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:34.839276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323fba94-3893-4a7f-8457-f04de13c5af8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:34.884296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:34.886159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:34.911211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-323fba94-3893-4a7f-8457-f04de13c5af8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:34.914562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-323fba94-3893-4a7f-8457-f04de13c5af8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.011942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 819/1662] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:35.020527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.021319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.022090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.050676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:35.052565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.054135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e43f4e-c09e-4571-bfc6-1911b6189cc9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.066148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 820/1663] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:00:35.067606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.069639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.070862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.072092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.072777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] PATH_INFO: `/v3/projects/5b1e21570e6f482591c0d2153d3e8783` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.077823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5b1e21570e6f482591c0d2153d3e8783)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.080201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.086341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a7d84-59d9-43c7-bbb3-26a84f981e1b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.093224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.094745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.095036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.095312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.095971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:35.097089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.098774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.132016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 821/1664] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:35.135341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.151595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-088f9458-fdaf-4292-9982-2bbe9b43f0ef admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.173386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.174011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.174387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.174561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.175365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.177695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.234984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5b1e21570e6f482591c0d2153d3e8783', 'request_id': 'req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.242669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5b1e21570e6f482591c0d2153d3e8783', 'request_id': 'req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.257573 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5b1e21570e6f482591c0d2153d3e8783', 'request_id': 'req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.273518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 822/1665] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:35 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:00:35.273518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.293787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.299004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] The token cache is being invalidate because project 5b1e21570e6f482591c0d2153d3e8783 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:35.301374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.304030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.312863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 844/1666] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:34 2022] DELETE /identity/v3/projects/5b1e21570e6f482591c0d2153d3e8783 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:35.312863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.318139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.364140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.430801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:35.516615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ac03f8-4a4c-4b46-8129-5780f0dcdec6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.526013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b30f-99b1-4662-912f-44c11abac99d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.536336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.536948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.537274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.537518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.538132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.541483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.542208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.542497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.542911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] PATH_INFO: `/v3/projects/47fabb201b0344cfa6b88a7b99e7367b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.547001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47fabb201b0344cfa6b88a7b99e7367b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.547001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: WARNING py.warnings [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 25 03:00:35.547001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: warnings.warn(msg) Aug 25 03:00:35.547001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: Aug 25 03:00:35.548549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.550616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.625217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 845/1667] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:35 2022] POST /identity/v3/users => generated 287 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:35.628640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.637486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.667635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8758175-3fc2-4676-85c9-58497170ccc1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:35.684921 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:35.687709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:35.688401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:35.688872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] PATH_INFO: `/v3/users/ea6f163dc7194bdb8c67fdec53fe224e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:35.693235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea6f163dc7194bdb8c67fdec53fe224e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:35.697457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:35.730145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47fabb201b0344cfa6b88a7b99e7367b', 'request_id': 'req-8d383beb-0ae3-4931-8fd7-494aa56bbe67'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.744648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47fabb201b0344cfa6b88a7b99e7367b', 'request_id': 'req-8d383beb-0ae3-4931-8fd7-494aa56bbe67'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.768814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47fabb201b0344cfa6b88a7b99e7367b', 'request_id': 'req-8d383beb-0ae3-4931-8fd7-494aa56bbe67'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.817561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] The token cache is being invalidate because project 47fabb201b0344cfa6b88a7b99e7367b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:35.818780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.819741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.829483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 823/1668] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:35 2022] DELETE /identity/v3/projects/47fabb201b0344cfa6b88a7b99e7367b => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:35.829483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.829483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:35.833166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea6f163dc7194bdb8c67fdec53fe224e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.834865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea6f163dc7194bdb8c67fdec53fe224e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.851774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea6f163dc7194bdb8c67fdec53fe224e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.866058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea6f163dc7194bdb8c67fdec53fe224e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.901419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea6f163dc7194bdb8c67fdec53fe224e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:35.913294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 846/1669] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:35 2022] DELETE /identity/v3/users/ea6f163dc7194bdb8c67fdec53fe224e => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:35.916834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:35.920582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:36.048805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d383beb-0ae3-4931-8fd7-494aa56bbe67 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.192841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.193522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.193802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.194098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.194736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.196679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.204422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2e4a2f-e292-4491-853f-fb930cd6ef63 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.219598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.223708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.224695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.225105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.225517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] PATH_INFO: `/v3/users/1a2fa63c8c954b0d952a3b3f6da5d0aa` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.226783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 824/1670] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:35 2022] GET /identity/v3/roles => generated 1420 bytes in 400 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:36.228376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2fa63c8c954b0d952a3b3f6da5d0aa)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.231625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.233026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.235800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:36.278378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:36.281932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d08f8b-b9d4-4c5b-a4b5-82634794d4a2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.301455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.302199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.304114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.306458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.307254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.312596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.341007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 825/1671] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:36 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:00:36.348734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.365177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2fa63c8c954b0d952a3b3f6da5d0aa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:36.366104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2fa63c8c954b0d952a3b3f6da5d0aa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:36.381316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1839720f-1a11-4538-9442-f38c60eeeaba admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.397693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2fa63c8c954b0d952a3b3f6da5d0aa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:36.403898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.411761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.412384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.412462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] PATH_INFO: `/v3/projects/c116296a75eb435dac8a5489fc97612c/users/7b1193f6a2154a80aa2c44d3e10b6221/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.422844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2fa63c8c954b0d952a3b3f6da5d0aa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:36.448712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-eee75b09-c165-4954-baf1-f92a13535cfe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2fa63c8c954b0d952a3b3f6da5d0aa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:36.469686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c116296a75eb435dac8a5489fc97612c, user_id=7b1193f6a2154a80aa2c44d3e10b6221, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.480219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 847/1672] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:35 2022] DELETE /identity/v3/users/1a2fa63c8c954b0d952a3b3f6da5d0aa => generated 0 bytes in 563 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:36.482262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:36.521994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 826/1673] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:36 2022] PUT /identity/v3/projects/c116296a75eb435dac8a5489fc97612c/users/7b1193f6a2154a80aa2c44d3e10b6221/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:36.536899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.537137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.541799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.613564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] MFA Rules not processed for user `7b1193f6a2154a80aa2c44d3e10b6221`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:36.615335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:36.768732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 848/1674] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:36 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:36.770735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:36.774162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:36.972271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c58084-df78-4478-a1c0-b11764821ca6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:36.989449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:36.990058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:36.990345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:36.990608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:36.991230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:36.993708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.081909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 827/1675] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:36 2022] POST /identity/v3/projects => generated 371 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:37.086335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.110920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59593340-237f-4f9d-932c-7c1cd7f686a0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.253692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.254427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.255155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.255408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.256697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.259385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.318957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 849/1676] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:37 2022] POST /identity/v3/users => generated 292 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:37.323907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.344602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e8141-53ea-4025-9951-54b13b7e8f21 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.383006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.384990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.387176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.390393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.393315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.398279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.434660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 828/1677] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:37.438548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.470129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2173ba5d-a4f6-4513-9ff6-4ed0d7ea5ee7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.496809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.497514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.497794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.498633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] PATH_INFO: `/v3/projects/fd2b1eafbde541368107abec74fe4209/users/316040bc14a74063b930210c116ece0a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.549899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:37.574788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2b1eafbde541368107abec74fe4209, user_id=316040bc14a74063b930210c116ece0a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.580189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.603947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.605154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:37.631939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 850/1678] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:37 2022] PUT /identity/v3/projects/fd2b1eafbde541368107abec74fe4209/users/316040bc14a74063b930210c116ece0a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:37.633272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.642385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c52e098-bd8c-45c3-806b-8fc6c4d23f43 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.794597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2060539e-4aec-4a41-866f-ff804ead5193 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.807145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.807784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.808137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.808463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.809130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.813299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.848756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.849812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.850230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.850639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] PATH_INFO: `/v3/users/e8787ae5e89f4d8aa44497e9afc3d186` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.850745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 851/1679] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:37 2022] GET /identity/v3/roles => generated 1420 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:37.854499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8787ae5e89f4d8aa44497e9afc3d186)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.861609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.862268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.892953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e8a63f-3fc5-4043-b9b1-e92023b41bcd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:37.908885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:37.909789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:37.910258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:37.910693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] PATH_INFO: `/v3/projects/fd2b1eafbde541368107abec74fe4209/users/316040bc14a74063b930210c116ece0a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:37.915434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] RBAC: Authorizing `identity:create_grant(project_id=fd2b1eafbde541368107abec74fe4209, user_id=316040bc14a74063b930210c116ece0a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:37.918413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:37.965153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 852/1680] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:37 2022] PUT /identity/v3/projects/fd2b1eafbde541368107abec74fe4209/users/316040bc14a74063b930210c116ece0a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:37.966318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:37.969268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.021420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.035996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8787ae5e89f4d8aa44497e9afc3d186'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.038850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8787ae5e89f4d8aa44497e9afc3d186'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.065028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8787ae5e89f4d8aa44497e9afc3d186'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.083126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8787ae5e89f4d8aa44497e9afc3d186'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.103395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f6423484-164d-4b8c-8d60-f8476edc7c05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8787ae5e89f4d8aa44497e9afc3d186'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.113805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 829/1681] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:37 2022] DELETE /identity/v3/users/e8787ae5e89f4d8aa44497e9afc3d186 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:00:38.115385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fc80-3679-43f0-99b0-37fc8c440d5e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.115836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fc80-3679-43f0-99b0-37fc8c440d5e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.116269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa02fc80-3679-43f0-99b0-37fc8c440d5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.170174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118d60e2-5d81-4b58-887d-62a94321fcad admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.181774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-aa02fc80-3679-43f0-99b0-37fc8c440d5e None None] MFA Rules not processed for user `316040bc14a74063b930210c116ece0a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:38.183435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-aa02fc80-3679-43f0-99b0-37fc8c440d5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.331589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.332423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.332861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.333247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] PATH_INFO: `/v3/projects/4591729f03704b90a23cf8e2507de36e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.336066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4591729f03704b90a23cf8e2507de36e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.338702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.414124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.415611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 830/1682] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:38.418549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78ebf-cd3b-4a0e-9fef-da833f7e098d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.427413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78ebf-cd3b-4a0e-9fef-da833f7e098d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.429113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc78ebf-cd3b-4a0e-9fef-da833f7e098d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.481821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1bc78ebf-cd3b-4a0e-9fef-da833f7e098d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:38.482983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1bc78ebf-cd3b-4a0e-9fef-da833f7e098d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.500002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4591729f03704b90a23cf8e2507de36e', 'request_id': 'req-49a39686-f227-40e2-812f-bae298c9c6f5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.521198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4591729f03704b90a23cf8e2507de36e', 'request_id': 'req-49a39686-f227-40e2-812f-bae298c9c6f5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.542198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4591729f03704b90a23cf8e2507de36e', 'request_id': 'req-49a39686-f227-40e2-812f-bae298c9c6f5'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.562164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] The token cache is being invalidate because project 4591729f03704b90a23cf8e2507de36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:38.562522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.565817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:38.574072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 853/1683] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:37 2022] DELETE /identity/v3/projects/4591729f03704b90a23cf8e2507de36e => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:38.576475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.578067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.661073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 831/1684] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:38.661869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.662850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.664248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.680144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a39686-f227-40e2-812f-bae298c9c6f5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.698196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.698841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.699117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.699389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.702425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.716606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:38.717593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.742425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 832/1685] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:38.748879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.748879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.834745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:38.840928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.842391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619f0e85-3382-4078-9c2e-fc84083cff02 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.875481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 854/1686] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:38.877195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.877479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.877758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.883102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9b0f3b-e181-41ef-9b83-14241c73e0fe None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.901635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.902270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.902549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.902820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.922416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.927429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:38.929151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:38.930483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:38.947678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 833/1687] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:38.953740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 855/1688] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:38.958031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:38.971453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a2bf9a1-0179-477d-b9ed-507d799cea58 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:38.981609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:38.982705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:38.985476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:38.985911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:38.986714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:38.987159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:38.989448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.013096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 834/1689] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:00:39.019225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.043377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd007332-72b8-438f-899d-77e6a1cc7712 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.058610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.060700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.061410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.061826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.064179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.070306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.083799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.086388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:39.123058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9be318-a020-4d03-8f5c-34191568fbf8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.149951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.157269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.157560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.161131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] PATH_INFO: `/v3/projects/722a00f039164480b92e5d887b8c7186` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.165173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] RBAC: Authorizing `identity:delete_project(project_id=722a00f039164480b92e5d887b8c7186)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.171736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.201641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 856/1690] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:39 2022] POST /identity/v3/projects => generated 387 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:39.204097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.355509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:39.379463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '722a00f039164480b92e5d887b8c7186', 'request_id': 'req-c655bc6c-4c35-4837-8fab-c0841aadad60'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:39.400850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '722a00f039164480b92e5d887b8c7186', 'request_id': 'req-c655bc6c-4c35-4837-8fab-c0841aadad60'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:39.435276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '722a00f039164480b92e5d887b8c7186', 'request_id': 'req-c655bc6c-4c35-4837-8fab-c0841aadad60'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:39.466171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ff8a73-9495-4c21-9e42-7afa0ba5b70d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.476338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] The token cache is being invalidate because project 722a00f039164480b92e5d887b8c7186 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:39.476733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:39.478642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c655bc6c-4c35-4837-8fab-c0841aadad60 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:39.485282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 835/1691] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:39 2022] DELETE /identity/v3/projects/722a00f039164480b92e5d887b8c7186 => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:00:39.486823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a67d-4408-484a-a0ae-7995e3b433a8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.489815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a67d-4408-484a-a0ae-7995e3b433a8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.491755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e2a67d-4408-484a-a0ae-7995e3b433a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.567203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-67e2a67d-4408-484a-a0ae-7995e3b433a8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:39.572399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67e2a67d-4408-484a-a0ae-7995e3b433a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:39.655130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.657588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.659338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.659846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.660729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.663630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.737198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 857/1692] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:39 2022] POST /identity/v3/users => generated 294 bytes in 534 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:39.740310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 836/1693] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:39.742593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.744002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.744200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.744413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.753627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:39.786102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:39.788292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:39.794612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ea4bd8-92a3-465c-b500-a5e93a89f7d5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.814892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 837/1694] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:39.816310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.816867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.817120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.817349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.817741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.818516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.820260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.837236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781fdc58-3e5e-4ff5-92c3-b437fe41ba8f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.850799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.851457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.851990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.851990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.854743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:39.858641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.859961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.862772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 858/1695] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:39.867075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.890781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468563c7-2d78-4734-8f11-84fa19160e26 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.891363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 838/1696] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:39.897413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:39.905018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.905795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.906408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.907235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.910107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.911852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.921133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009d1ff0-33e3-42f0-b8e4-73cf88c8b932 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:39.938364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 859/1697] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:39 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:00:39.939981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:39.941122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:39.941122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:39.941282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:39.941883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:39.944492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:39.955248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.004361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81cb11cc-f153-475d-aafe-530dddd0105c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.014478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.015304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.015705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.015705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] PATH_INFO: `/v3/projects/588e00da01e744ce98f557aa3cf13ba4/users/0090314c8d5e4e3bb85ef98fc551f0f0/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.057614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588e00da01e744ce98f557aa3cf13ba4, user_id=0090314c8d5e4e3bb85ef98fc551f0f0, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:40.059630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 839/1698] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:39 2022] POST /identity/v3/projects => generated 365 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:40.060764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:40.063860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.069129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:40.115116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 860/1699] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:39 2022] PUT /identity/v3/projects/588e00da01e744ce98f557aa3cf13ba4/users/0090314c8d5e4e3bb85ef98fc551f0f0/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:40.116790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:40.118837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.230301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-254ee8cc-8510-4b2d-b4c4-84331f2d0eb2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.238479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f81fd-e945-4257-82b9-f6c2867a419d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.239493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f81fd-e945-4257-82b9-f6c2867a419d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.239778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f81fd-e945-4257-82b9-f6c2867a419d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.240070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f81fd-e945-4257-82b9-f6c2867a419d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.240722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f81fd-e945-4257-82b9-f6c2867a419d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:40.243413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5f81fd-e945-4257-82b9-f6c2867a419d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:40.287190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 861/1700] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:40 2022] POST /identity/v3/users => generated 283 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:40.288894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.289367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.289875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.353563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f66505-c674-4cf7-b922-4f120f8560e8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.359103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:40.384968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.385506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] MFA Rules not processed for user `0090314c8d5e4e3bb85ef98fc551f0f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:40.385680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.385970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.386245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] PATH_INFO: `/v3/users/7b1193f6a2154a80aa2c44d3e10b6221` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.388741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b1193f6a2154a80aa2c44d3e10b6221)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:40.395394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:40.396650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:40.548435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b1193f6a2154a80aa2c44d3e10b6221'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:40.549324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b1193f6a2154a80aa2c44d3e10b6221'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:40.571261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b1193f6a2154a80aa2c44d3e10b6221'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:40.600961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 862/1701] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:40.601857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.606787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b1193f6a2154a80aa2c44d3e10b6221'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:40.615601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b1193f6a2154a80aa2c44d3e10b6221'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:40.626450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680b15c-7a3e-47e9-a4d5-2485249a9d0f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.633091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 840/1702] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:40 2022] DELETE /identity/v3/users/7b1193f6a2154a80aa2c44d3e10b6221 => generated 0 bytes in 570 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:40.639620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.639929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943e454e-80ef-4a7c-9055-cf7627254da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.640553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e454e-80ef-4a7c-9055-cf7627254da0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.640827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e454e-80ef-4a7c-9055-cf7627254da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.641098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e454e-80ef-4a7c-9055-cf7627254da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.641763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e454e-80ef-4a7c-9055-cf7627254da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:40.643705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943e454e-80ef-4a7c-9055-cf7627254da0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:40.645056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:40.662881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 863/1703] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:40.664194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.664513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.664838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.728742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:40.729997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:40.910795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 864/1704] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:40.912240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:40.918029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:40.963931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eca92fd-6d6b-4deb-9084-78830b8e6ad9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.966203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775b6b2-24c6-401c-bad5-9cd1910a3887 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:40.980378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.981408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:40.982439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.983321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:40.983824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.984380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:40.985634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.986176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:40.987434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:40.987760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:40.991724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:40.995092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.029008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 865/1705] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:40 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:41.031522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.038431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:41.083182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 841/1706] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:40 2022] POST /identity/v3/projects => generated 387 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:41.083182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.123712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.208220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82085f7b-043b-4a32-8955-d84960fb1ca8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.293681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d48cda-592e-4173-99bc-0a268268f48c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.311661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.314483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.315815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.316279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] PATH_INFO: `/v3/projects/f57abd9925d140a3845ec94b30508dc1/users/d87144f8e37f45d4b7be33c1f3aa0f7d/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.375524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:41.397238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f57abd9925d140a3845ec94b30508dc1, user_id=d87144f8e37f45d4b7be33c1f3aa0f7d, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.407475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.448689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 842/1707] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:41 2022] PUT /identity/v3/projects/f57abd9925d140a3845ec94b30508dc1/users/d87144f8e37f45d4b7be33c1f3aa0f7d/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:41.451273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc602449-cec5-4028-8418-971664b4f25a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.451498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.453585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602449-cec5-4028-8418-971664b4f25a service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.454454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602449-cec5-4028-8418-971664b4f25a service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.454828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc602449-cec5-4028-8418-971664b4f25a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.501411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602449-cec5-4028-8418-971664b4f25a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.505858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc602449-cec5-4028-8418-971664b4f25a service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.532276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 866/1708] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 502 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:41.533757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.534142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.534518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.631384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] MFA Rules not processed for user `d87144f8e37f45d4b7be33c1f3aa0f7d`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:41.636287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:41.682693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7bd758-d6ad-4259-ba31-a981801b55d5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.702151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.705021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.706179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.708748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.711004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.720353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.788008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 843/1709] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:41 2022] POST /identity/v3/users => generated 300 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:41.790301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.796863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:41.839145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04fb01f-aca2-47a9-b586-37a1b312fd28 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.865096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.867320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.867646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.868074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] PATH_INFO: `/v3/projects/859b84acfc89473aabe2c2737b68a3a0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:41.869496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] RBAC: Authorizing `identity:delete_project(project_id=859b84acfc89473aabe2c2737b68a3a0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:41.871445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:41.917334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 867/1710] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:41 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:41.921008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:41.970736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156fe47-99e7-4dc1-9466-99b6ee2d11b6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:41.998306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:41.998857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:41.999134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:41.999402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.000075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.005918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.066264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '859b84acfc89473aabe2c2737b68a3a0', 'request_id': 'req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:42.083127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 868/1711] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:41 2022] GET /identity/v3/roles => generated 1420 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:42.090065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '859b84acfc89473aabe2c2737b68a3a0', 'request_id': 'req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:42.096035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.113586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '859b84acfc89473aabe2c2737b68a3a0', 'request_id': 'req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:42.143483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521471e2-ef7d-4dae-9085-23eea910abf7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.149435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] The token cache is being invalidate because project 859b84acfc89473aabe2c2737b68a3a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:42.150049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:42.158740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:42.161127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 844/1712] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:41 2022] DELETE /identity/v3/projects/859b84acfc89473aabe2c2737b68a3a0 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:42.162793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.166280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:42.210034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.353645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f734c5-2b1a-4580-b3ca-3a4168fbb44c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.366506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee1f47c-ebe2-408a-a42d-c439113a73ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.368907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f47c-ebe2-408a-a42d-c439113a73ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.369260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f47c-ebe2-408a-a42d-c439113a73ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.369616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee1f47c-ebe2-408a-a42d-c439113a73ba admin admin] PATH_INFO: `/v3/projects/68a0fc8f91db4947be9445c21cbd54c4/users/0e432f056b8445fb97c5fbfdbdee3df8/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.374095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.376298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.376770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.377310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.378847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.386914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.409290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f47c-ebe2-408a-a42d-c439113a73ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a0fc8f91db4947be9445c21cbd54c4, user_id=0e432f056b8445fb97c5fbfdbdee3df8, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.414067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cee1f47c-ebe2-408a-a42d-c439113a73ba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.444141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 845/1713] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:42 2022] PUT /identity/v3/projects/68a0fc8f91db4947be9445c21cbd54c4/users/0e432f056b8445fb97c5fbfdbdee3df8/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:42.449548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.449840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.452481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.467300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 869/1714] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:42 2022] POST /identity/v3/projects => generated 365 bytes in 383 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:42.470508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.511384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:42.512665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:42.637398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:42.688588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ebed3e-0eb6-4f98-89f6-abefe235af54 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.698010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 846/1715] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:42.699117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.700997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:42.707328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddce29-f7e3-4345-82c8-c278c1b0ee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.710947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddce29-f7e3-4345-82c8-c278c1b0ee7e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.712033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddce29-f7e3-4345-82c8-c278c1b0ee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.713482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddce29-f7e3-4345-82c8-c278c1b0ee7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.714943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddce29-f7e3-4345-82c8-c278c1b0ee7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.717841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddce29-f7e3-4345-82c8-c278c1b0ee7e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.730141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5313717b-26d8-43e4-bee8-7e133275d886 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.745195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 870/1716] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:42.746839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.747126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.747403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.750071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b074f0e-228c-4028-807a-6f1c0ea90587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.750906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074f0e-228c-4028-807a-6f1c0ea90587 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.751194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074f0e-228c-4028-807a-6f1c0ea90587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.751472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b074f0e-228c-4028-807a-6f1c0ea90587 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.752151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074f0e-228c-4028-807a-6f1c0ea90587 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.756109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b074f0e-228c-4028-807a-6f1c0ea90587 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.807060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] MFA Rules not processed for user `2a0b55bf8f614a948f2cbd684f8faca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:42.808533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:42.811671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 847/1717] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:42 2022] POST /identity/v3/users => generated 289 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:42.813267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.813664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.814578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.862295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:42.865891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:42.890205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 848/1718] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:42.890205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.912095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc99b7cc-2d2c-47dc-9623-5c343e5881ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:42.925695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:42.926497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:42.926786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:42.927204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] PATH_INFO: `/v3/projects/68a0fc8f91db4947be9445c21cbd54c4/users/0e432f056b8445fb97c5fbfdbdee3df8/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:42.929831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 871/1719] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:42 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:42.931062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=68a0fc8f91db4947be9445c21cbd54c4, user_id=0e432f056b8445fb97c5fbfdbdee3df8, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:42.942084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.950831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:42.975868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 849/1720] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:42 2022] PUT /identity/v3/projects/68a0fc8f91db4947be9445c21cbd54c4/users/0e432f056b8445fb97c5fbfdbdee3df8/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:42.976763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:42.977060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b381e08-e2be-4f5d-bdac-0ea3ea1a2695 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.165126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.175251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b79205-3d47-4107-9f48-a410e375d8ff admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.183256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7946f406-53b3-4af4-ad03-19ff85b8ec87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.184127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f406-53b3-4af4-ad03-19ff85b8ec87 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.184257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f406-53b3-4af4-ad03-19ff85b8ec87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.184456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7946f406-53b3-4af4-ad03-19ff85b8ec87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.185124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946f406-53b3-4af4-ad03-19ff85b8ec87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.187330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7946f406-53b3-4af4-ad03-19ff85b8ec87 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.189837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.190454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.190732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.191010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.191743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:43.192067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.194517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58aefba2-e1bb-4be8-b71b-ae2342a4f886 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.212321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 872/1721] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/roles => generated 1420 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:43.216773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.217521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.217521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.224523 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 850/1722] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:43.225344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.225631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.225906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.262825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] MFA Rules not processed for user `2a0b55bf8f614a948f2cbd684f8faca3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:43.267401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:43.286020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] MFA Rules not processed for user `0e432f056b8445fb97c5fbfdbdee3df8`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:43.287247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:43.412261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 873/1723] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:43.412261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.453667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83836d5b-895e-4f8d-8640-d6a37df31b29 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.469677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.470431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.474961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.475265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] PATH_INFO: `/v3/projects/2db2b184f9f14b62ac034dd6dce1004b/users/f637353bb71249e1b6dafff36a69bfe6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.485013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:43.510413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 851/1724] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:43 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:43.512080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.520082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db2b184f9f14b62ac034dd6dce1004b, user_id=f637353bb71249e1b6dafff36a69bfe6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.525901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.528244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d82632-90f7-4907-b8a9-3c89af1a930d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.537842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.539018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.539217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.540210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.541684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.553093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.575761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 874/1725] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:43 2022] PUT /identity/v3/projects/2db2b184f9f14b62ac034dd6dce1004b/users/f637353bb71249e1b6dafff36a69bfe6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:43.577455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.583591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:43.626630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 852/1726] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:43 2022] POST /identity/v3/projects => generated 355 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:43.626630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:43.638420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:43.753418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1588208-e8ca-4627-9d8d-c58e010a2a9e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.850852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba7449b-d053-45ba-80b3-fca013ae0ce8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:43.863709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.865691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.866206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.866733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.929304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:43.930678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:43.931191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:43.931191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] PATH_INFO: `/v3/projects/c116296a75eb435dac8a5489fc97612c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:43.937283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c116296a75eb435dac8a5489fc97612c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:43.939582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:43.991431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.009515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.012550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.039320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 853/1727] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:44.044563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.048428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:44.065297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c116296a75eb435dac8a5489fc97612c', 'request_id': 'req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.097835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c116296a75eb435dac8a5489fc97612c', 'request_id': 'req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.121731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c116296a75eb435dac8a5489fc97612c', 'request_id': 'req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.136062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] The token cache is being invalidate because project c116296a75eb435dac8a5489fc97612c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:44.136353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.137037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.141721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 875/1728] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:43 2022] DELETE /identity/v3/projects/c116296a75eb435dac8a5489fc97612c => generated 0 bytes in 562 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:44.142587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.145385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:44.201954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.221407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd82095b-d5c1-470b-8778-31e06445f5ee service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.312413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ce45da-c915-4631-a29b-c3c4a34f9b1e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.331995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.332653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.332931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.333202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.334376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.335481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.355837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.356491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.356765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.357040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.357918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 876/1729] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:44.360227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:44.361509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.364654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:44.393319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fef71f-daf7-4d4e-9e8c-e777ec3f9347 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.408312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.408312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.408312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.408312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.408697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.410405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.450861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 877/1730] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:44 2022] POST /identity/v3/users => generated 278 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:44.451844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.453643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:44.469489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf4890-06e6-45d2-8b91-a1cb9e6ace0c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.475266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.475911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.476235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.476478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] PATH_INFO: `/v3/users/316040bc14a74063b930210c116ece0a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.478827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=316040bc14a74063b930210c116ece0a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.480488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.497668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.500857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.531193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 854/1731] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:44.532080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.569968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59267bc1-928e-49e8-80f7-83d14232e79a service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.586079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:44.588211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.588596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.588765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] PATH_INFO: `/v3/projects/2db2b184f9f14b62ac034dd6dce1004b/users/f637353bb71249e1b6dafff36a69bfe6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.593418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '316040bc14a74063b930210c116ece0a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.593853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] RBAC: Authorizing `identity:create_grant(project_id=2db2b184f9f14b62ac034dd6dce1004b, user_id=f637353bb71249e1b6dafff36a69bfe6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:44.594286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '316040bc14a74063b930210c116ece0a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.598303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:44.616339 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '316040bc14a74063b930210c116ece0a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.626769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '316040bc14a74063b930210c116ece0a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.641904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 855/1732] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:44 2022] PUT /identity/v3/projects/2db2b184f9f14b62ac034dd6dce1004b/users/f637353bb71249e1b6dafff36a69bfe6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:44.642315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.671934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1fd2f5f5-74f6-4aa1-b15f-70e7523aaf60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '316040bc14a74063b930210c116ece0a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:44.688062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 878/1733] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:44 2022] DELETE /identity/v3/users/316040bc14a74063b930210c116ece0a => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:44.688062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:44.688062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:44.688062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:44.750208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] MFA Rules not processed for user `ce7b1f7925614a2b9cf9d2c7eaf2b7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:44.751345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:44.861811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.888308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a7312c-522c-434c-9f6f-61a4b0d3231e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:44.940170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:44.953945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 879/1734] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:44 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:44.955060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:44.957552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.011143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f3bf15-727c-4f05-b53c-59cd345c7d83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.011896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3bf15-727c-4f05-b53c-59cd345c7d83 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.012137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3bf15-727c-4f05-b53c-59cd345c7d83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.012422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f3bf15-727c-4f05-b53c-59cd345c7d83 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.016359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3bf15-727c-4f05-b53c-59cd345c7d83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.016359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f3bf15-727c-4f05-b53c-59cd345c7d83 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.035105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 856/1735] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:44 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:45.036770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.037226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.037670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.089134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] MFA Rules not processed for user `f637353bb71249e1b6dafff36a69bfe6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:45.091270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.115936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3102e5d3-633e-40ae-b335-c928ba26d1b3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.126210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.126796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.127084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.127358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] PATH_INFO: `/v3/users/0090314c8d5e4e3bb85ef98fc551f0f0` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.129416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] RBAC: Authorizing `identity:delete_user(user_id=0090314c8d5e4e3bb85ef98fc551f0f0)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.133164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.251584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0090314c8d5e4e3bb85ef98fc551f0f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.258260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0090314c8d5e4e3bb85ef98fc551f0f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.284143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0090314c8d5e4e3bb85ef98fc551f0f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.300165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0090314c8d5e4e3bb85ef98fc551f0f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.327722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 857/1736] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:45 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:45.329274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.344228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.345511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0090314c8d5e4e3bb85ef98fc551f0f0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.360414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 880/1737] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:44 2022] DELETE /identity/v3/users/0090314c8d5e4e3bb85ef98fc551f0f0 => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:45.364326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.369108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.511469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b3890d-1da0-4de2-8837-13e126d1626d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.525919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cba195-34dc-4423-81e3-219b49fc6b9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.526733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cba195-34dc-4423-81e3-219b49fc6b9b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.527113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cba195-34dc-4423-81e3-219b49fc6b9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.527677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cba195-34dc-4423-81e3-219b49fc6b9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.528391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cba195-34dc-4423-81e3-219b49fc6b9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.530244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cba195-34dc-4423-81e3-219b49fc6b9b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.542256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f622c6-a02f-4a08-80cb-5744514152e7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.550516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.552367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 881/1738] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/roles => generated 1420 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:45.566042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154468b-2cbe-4fb6-909e-702f896766a9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.567255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154468b-2cbe-4fb6-909e-702f896766a9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.567706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d154468b-2cbe-4fb6-909e-702f896766a9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.570106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 882/1739] 10.222.0.72 () {54 vars in 912 bytes} [Thu Aug 25 03:00:45 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:45.572187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154468b-2cbe-4fb6-909e-702f896766a9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.578199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d154468b-2cbe-4fb6-909e-702f896766a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.640864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:45.700083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.700716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.701000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.701279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.704919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.716584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d154468b-2cbe-4fb6-909e-702f896766a9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.721512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.722252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.722632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.723014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.725160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.838176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.839902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c260de44-2d46-499c-a562-cfa0c6990b83 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.842903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.844405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.850809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 858/1740] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 522 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:45.852684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.853137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.853626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.863913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 883/1741] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:45 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:45.864804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.866147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.876308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:45.877544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:45.881540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11f7a60-4691-42e5-905a-fae93a6bc700 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.890077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.890250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 859/1742] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:45.890349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.890349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.890517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:45.891059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] PATH_INFO: `/v3/projects/fd2b1eafbde541368107abec74fe4209` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.891059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fd2b1eafbde541368107abec74fe4209)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.891958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.908423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c41c030-cb78-47fb-8187-1ccc8f3a9829 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:45.915314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a1c3b5-0bff-418f-8be5-081750a7b45b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:45.916643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c3b5-0bff-418f-8be5-081750a7b45b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:45.916932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c3b5-0bff-418f-8be5-081750a7b45b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:45.917210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a1c3b5-0bff-418f-8be5-081750a7b45b admin admin] PATH_INFO: `/v3/projects/a42ae6ec871849e6940c9790ec3830c1/users/b31c16d1c4004b8f837c8d325f9c83a6/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:45.942203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c3b5-0bff-418f-8be5-081750a7b45b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a42ae6ec871849e6940c9790ec3830c1, user_id=b31c16d1c4004b8f837c8d325f9c83a6, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:45.946275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a1c3b5-0bff-418f-8be5-081750a7b45b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:45.968964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fd2b1eafbde541368107abec74fe4209', 'request_id': 'req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.984642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fd2b1eafbde541368107abec74fe4209', 'request_id': 'req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:45.993323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 860/1743] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:45 2022] PUT /identity/v3/projects/a42ae6ec871849e6940c9790ec3830c1/users/b31c16d1c4004b8f837c8d325f9c83a6/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:46.009312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fd2b1eafbde541368107abec74fe4209', 'request_id': 'req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:46.022600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f01e-99f8-4645-abec-cc17b8785b9a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.022888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f01e-99f8-4645-abec-cc17b8785b9a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.023167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f29f01e-99f8-4645-abec-cc17b8785b9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.027746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] The token cache is being invalidate because project fd2b1eafbde541368107abec74fe4209 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:46.028137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:46.028914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fdf74b1e-b25b-4ad1-9dd6-dfc04f0f399a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:46.036951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 884/1744] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:45 2022] DELETE /identity/v3/projects/fd2b1eafbde541368107abec74fe4209 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:46.038489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.038875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.039234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.117495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] MFA Rules not processed for user `67d1de462c2a40be909e32e1846d77ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.122962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.179639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9f29f01e-99f8-4645-abec-cc17b8785b9a None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.183416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9f29f01e-99f8-4645-abec-cc17b8785b9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.287983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:46.386054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 885/1745] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 349 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.386998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:46.398068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.401803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 861/1746] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:45 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.409060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70313-2e61-47bf-b8c9-a1aa67ce18c1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.409060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70313-2e61-47bf-b8c9-a1aa67ce18c1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.409060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab70313-2e61-47bf-b8c9-a1aa67ce18c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.424131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280377b2-b155-43d2-a79d-3c46ff2dc4d3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:46.431944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:46.433084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.433342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.433805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.436112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.483509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:46.510907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6ab70313-2e61-47bf-b8c9-a1aa67ce18c1 None None] MFA Rules not processed for user `b31c16d1c4004b8f837c8d325f9c83a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.517207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6ab70313-2e61-47bf-b8c9-a1aa67ce18c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.624424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:46.632246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fcfd84-f140-4c3a-90e8-fa04f919519d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:46.669326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 886/1747] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:46.672337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.672621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.672896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.733689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 862/1748] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.738751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.740330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.740624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.742276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.747135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.784445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 887/1749] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.791022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:46.797879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.826750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] MFA Rules not processed for user `67d1de462c2a40be909e32e1846d77ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:46.839165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.850553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76738-d388-4710-a0de-e1b4cb1540fc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:46.864775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a29ceb-dd10-4275-abd6-b45ed11cee24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:46.866103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29ceb-dd10-4275-abd6-b45ed11cee24 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.867342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 863/1750] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:46.877574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29ceb-dd10-4275-abd6-b45ed11cee24 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.877835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:46.878454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a29ceb-dd10-4275-abd6-b45ed11cee24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.882536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:46.912899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a29ceb-dd10-4275-abd6-b45ed11cee24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:46.919642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a29ceb-dd10-4275-abd6-b45ed11cee24 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:46.955284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085a5fc9-73ff-44d3-978d-58203416f408 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:46.965422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 888/1751] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:46 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:46.966778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.968666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.968949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.970048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:46.971051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:46.971334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:46.974820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:46.995336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:46.998754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.065191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:47.069534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:47.103813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 864/1752] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/projects => generated 357 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:47.105884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.106411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 889/1753] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:47.108062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.110346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:47.111469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:47.146406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992670b6-4ea7-4e87-8fa2-5cbd465d2683 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.334366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16cb6e6-94a2-45af-ab95-7f3a62123f41 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.341040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.344675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.344932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.345203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] PATH_INFO: `/v3/users/d87144f8e37f45d4b7be33c1f3aa0f7d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.346883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d87144f8e37f45d4b7be33c1f3aa0f7d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.350477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.357709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.358424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.358679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.358959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.506108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd87144f8e37f45d4b7be33c1f3aa0f7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.506957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd87144f8e37f45d4b7be33c1f3aa0f7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.513198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:47.528555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd87144f8e37f45d4b7be33c1f3aa0f7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.539557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd87144f8e37f45d4b7be33c1f3aa0f7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.542270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.544753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.573972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd87144f8e37f45d4b7be33c1f3aa0f7d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.575263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 865/1754] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:47 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 470 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:47.576404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.581137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 890/1755] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:47 2022] DELETE /identity/v3/users/d87144f8e37f45d4b7be33c1f3aa0f7d => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:47.581934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.585854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:47.590816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487227a8-53a3-4400-a490-a1aa77bd07bc service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.599862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:47.724146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036359a2-eeda-4804-a9ba-236a3809b355 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.733524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.734215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.741497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.741811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.743817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:47.744182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.747061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.748572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6362a79d-ab69-40c8-9e2d-ee147bf79210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.750422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362a79d-ab69-40c8-9e2d-ee147bf79210 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.750715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362a79d-ab69-40c8-9e2d-ee147bf79210 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.750993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6362a79d-ab69-40c8-9e2d-ee147bf79210 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.753841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362a79d-ab69-40c8-9e2d-ee147bf79210 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.759069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6362a79d-ab69-40c8-9e2d-ee147bf79210 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.766391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 891/1756] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:47.767825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.770137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:47.805520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164745aa-8995-485d-af74-8ed6eec64a00 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.824713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:47.825503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.825793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.827539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] PATH_INFO: `/v3/projects/588e00da01e744ce98f557aa3cf13ba4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.828753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 866/1757] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:47 2022] POST /identity/v3/users => generated 285 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:47.832197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=588e00da01e744ce98f557aa3cf13ba4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:47.832312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:47.832312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:47.832312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:47.832520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:47.890595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:47.892880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:47.919931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 867/1758] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:47.923384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:47.931841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588e00da01e744ce98f557aa3cf13ba4', 'request_id': 'req-cbba365c-3ca9-460c-93bf-74e11de8dc85'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.940966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588e00da01e744ce98f557aa3cf13ba4', 'request_id': 'req-cbba365c-3ca9-460c-93bf-74e11de8dc85'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:47.948114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b3e5b72-a7b8-40c5-a7d3-99c86a639582 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:47.964129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588e00da01e744ce98f557aa3cf13ba4', 'request_id': 'req-cbba365c-3ca9-460c-93bf-74e11de8dc85'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.008963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] The token cache is being invalidate because project 588e00da01e744ce98f557aa3cf13ba4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:48.010475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.013309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.018494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 892/1759] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:47 2022] DELETE /identity/v3/projects/588e00da01e744ce98f557aa3cf13ba4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:48.019668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.024421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.165410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.167750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.167750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.168527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.169221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.170309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=2,keystone:DELETE=10,keystone:SELECT=88 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.174424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.229081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbba365c-3ca9-460c-93bf-74e11de8dc85 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.254000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 868/1760] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:47 2022] POST /identity/v3/projects => generated 383 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:48.254000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.256946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.257630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.259022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.259409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.259725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.260486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.262105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.309507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 893/1761] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/roles => generated 1420 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:48.310245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.316929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.351342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf994660-adac-4117-9d5b-b0a25514460f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.472582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b966f7-7767-428a-8b9e-0ae9b4cd3178 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.485751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.486280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.486569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.487348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.490593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.549467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.551348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.551874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.552592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] PATH_INFO: `/v3/users/0e432f056b8445fb97c5fbfdbdee3df8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.554416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] RBAC: Authorizing `identity:delete_user(user_id=0e432f056b8445fb97c5fbfdbdee3df8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.557049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.615593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.675016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0e432f056b8445fb97c5fbfdbdee3df8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.679145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0e432f056b8445fb97c5fbfdbdee3df8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.710430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0e432f056b8445fb97c5fbfdbdee3df8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.719933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0e432f056b8445fb97c5fbfdbdee3df8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.720591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.722525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:48.745046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0e432f056b8445fb97c5fbfdbdee3df8'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:48.755415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 869/1762] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:48.758356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.766744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.772125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 894/1763] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:48 2022] DELETE /identity/v3/users/0e432f056b8445fb97c5fbfdbdee3df8 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:48.772619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:48.780998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:48.802112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17755dcb-e0fe-4583-802a-0225af6d99a4 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.942270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:48.959616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71b7593-03e6-473e-b3f1-aac3266525fd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:48.973869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec3340e-9c38-4419-868f-bc6b9d25c5b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.974507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3340e-9c38-4419-868f-bc6b9d25c5b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.974789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3340e-9c38-4419-868f-bc6b9d25c5b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.975075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec3340e-9c38-4419-868f-bc6b9d25c5b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.975707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3340e-9c38-4419-868f-bc6b9d25c5b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:48.980865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8921904f-5317-44a8-a7a7-c70e5e88eb4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:48.981305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921904f-5317-44a8-a7a7-c70e5e88eb4d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:48.981588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921904f-5317-44a8-a7a7-c70e5e88eb4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:48.981864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8921904f-5317-44a8-a7a7-c70e5e88eb4d admin admin] PATH_INFO: `/v3/projects/eea603fae86843e6ae87e247a8f554b5/users/71564b25827f4e4582011c61eb32fcac/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:48.984151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec3340e-9c38-4419-868f-bc6b9d25c5b0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.018042 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921904f-5317-44a8-a7a7-c70e5e88eb4d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea603fae86843e6ae87e247a8f554b5, user_id=71564b25827f4e4582011c61eb32fcac, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.021253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8921904f-5317-44a8-a7a7-c70e5e88eb4d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.031610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 870/1764] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:48 2022] POST /identity/v3/users => generated 292 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:49.033140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02aabb-0e8e-49a6-ade9-1232e04301ba None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.033433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02aabb-0e8e-49a6-ade9-1232e04301ba None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.034122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a02aabb-0e8e-49a6-ade9-1232e04301ba None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.037906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 871/1765] 10.222.0.72 () {54 vars in 912 bytes} [Thu Aug 25 03:00:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:49.045577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bddbb5-6ef3-4436-9e7c-fc99d37590bb None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.045861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bddbb5-6ef3-4436-9e7c-fc99d37590bb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.046146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bddbb5-6ef3-4436-9e7c-fc99d37590bb None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.048135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 872/1766] 10.222.0.72 () {54 vars in 961 bytes} [Thu Aug 25 03:00:49 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:00:49.056194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bddbb5-6ef3-4436-9e7c-fc99d37590bb None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.063348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-54bddbb5-6ef3-4436-9e7c-fc99d37590bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:49.067354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 895/1767] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:48 2022] PUT /identity/v3/projects/eea603fae86843e6ae87e247a8f554b5/users/71564b25827f4e4582011c61eb32fcac/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:49.070285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41dbe-4c9e-4468-9703-f19fb11ab9b2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.070285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41dbe-4c9e-4468-9703-f19fb11ab9b2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.070285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f41dbe-4c9e-4468-9703-f19fb11ab9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.125964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f5f41dbe-4c9e-4468-9703-f19fb11ab9b2 None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:49.127220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f5f41dbe-4c9e-4468-9703-f19fb11ab9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:49.250185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bddbb5-6ef3-4436-9e7c-fc99d37590bb None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.262318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.263514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 896/1768] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:49.270270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.271495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.271832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.274410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.275874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.276832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.276832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.278441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.323074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 873/1769] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:49.324981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.342934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:49.350615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:49.359520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c39f5b-5ef1-4e95-8139-464ae23ef118 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.395265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.399901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.400127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.401251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.401251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.416508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.442738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 874/1770] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:49.449600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.485786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd58245-4a64-4cbb-8840-adeb5d8df270 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.512092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.512679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.515347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.515611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.521167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.522907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.562010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 875/1771] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:49.562904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.571261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:49.606368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 897/1772] 10.222.0.72 () {58 vars in 1058 bytes} [Thu Aug 25 03:00:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:49.607390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.616296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e83e2b8-6546-4255-a0da-dfc962ee4dde admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.625900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.626534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.626815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.627088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.640523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c9612d-e1c5-43fc-891a-a8ba21f813e2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.659828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.661570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.662251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.662528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.662814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] PATH_INFO: `/v3/projects/eea603fae86843e6ae87e247a8f554b5/users/71564b25827f4e4582011c61eb32fcac/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.665018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.671418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eea603fae86843e6ae87e247a8f554b5, user_id=71564b25827f4e4582011c61eb32fcac, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.675131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.684610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 876/1773] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:49.685511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.723271 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 898/1774] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:49 2022] PUT /identity/v3/projects/eea603fae86843e6ae87e247a8f554b5/users/71564b25827f4e4582011c61eb32fcac/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:49.724852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.748445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3940eb-ccf1-4398-9144-4cd67e1b4eda service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.803357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:49.875095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.876332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.876862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.877344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] PATH_INFO: `/v3/projects/a768f79f2b6c4c7690fcd4afaca77c91/users/2e1ad69f89c64966990ef6f68d8afa71/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.901696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cef32b4-e3e8-4854-a8a4-351ce3f012a7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:49.909007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a768f79f2b6c4c7690fcd4afaca77c91, user_id=2e1ad69f89c64966990ef6f68d8afa71, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.910594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:49.911297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:49.911585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:49.912071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:49.924730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.942847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:49.987195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:49.987195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffed8911-7fd2-416c-ba74-391a1ce13540 service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:49.992940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 877/1775] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:49 2022] PUT /identity/v3/projects/a768f79f2b6c4c7690fcd4afaca77c91/users/2e1ad69f89c64966990ef6f68d8afa71/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:49.994046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:49.998577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.003928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 899/1776] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:49 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:50.005798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:50.006088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:50.006943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:50.016775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:50.082772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] MFA Rules not processed for user `71564b25827f4e4582011c61eb32fcac`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:50.087132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.126649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ec6631-6c1b-4543-a56d-fff8b01bafb0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:50.135127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:50.136187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:50.136684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:50.137171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] PATH_INFO: `/v3/projects/f57abd9925d140a3845ec94b30508dc1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:50.140825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=f57abd9925d140a3845ec94b30508dc1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:50.143152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:50.249106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f57abd9925d140a3845ec94b30508dc1', 'request_id': 'req-a85c877a-ff40-45b4-8ba5-3a453181e7fb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.258414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f57abd9925d140a3845ec94b30508dc1', 'request_id': 'req-a85c877a-ff40-45b4-8ba5-3a453181e7fb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.266113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 900/1777] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:50 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:50.268184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f57abd9925d140a3845ec94b30508dc1', 'request_id': 'req-a85c877a-ff40-45b4-8ba5-3a453181e7fb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.277158 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:50.280628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.298124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] The token cache is being invalidate because project f57abd9925d140a3845ec94b30508dc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:50.300237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.302250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a85c877a-ff40-45b4-8ba5-3a453181e7fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.310981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 878/1778] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:49 2022] DELETE /identity/v3/projects/f57abd9925d140a3845ec94b30508dc1 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:50.310981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:50.311308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:50.311833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:50.318679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afc4f12-b4e9-4006-b403-f5b7a81c5de7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:50.365402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] MFA Rules not processed for user `2e1ad69f89c64966990ef6f68d8afa71`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:50.366638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.391007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:50.466287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:50.467005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:50.467428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:50.467719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] PATH_INFO: `/v3/projects/68a0fc8f91db4947be9445c21cbd54c4` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:50.468990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68a0fc8f91db4947be9445c21cbd54c4)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:50.471240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 879/1779] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:50 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:50.472242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:50.474323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.475514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:50.613647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eaa3cd6-343d-4a6d-81d6-c1e3c324ba15 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:50.643949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68a0fc8f91db4947be9445c21cbd54c4', 'request_id': 'req-fd529153-8d32-42d2-af10-0d4f35a23bf3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.644456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:50.650027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:50.651262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:50.653769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:50.657001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68a0fc8f91db4947be9445c21cbd54c4', 'request_id': 'req-fd529153-8d32-42d2-af10-0d4f35a23bf3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.658868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.686124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68a0fc8f91db4947be9445c21cbd54c4', 'request_id': 'req-fd529153-8d32-42d2-af10-0d4f35a23bf3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.752435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] The token cache is being invalidate because project 68a0fc8f91db4947be9445c21cbd54c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:50.752728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.753409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:50.766164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 901/1780] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:50 2022] DELETE /identity/v3/projects/68a0fc8f91db4947be9445c21cbd54c4 => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:50.767310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:50.778983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.827109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:50.870157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:50.871885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:50.889249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 880/1781] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:50 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:50.905251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:50.906787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:50.942638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268b00ac-15c9-4744-8f9b-5994223384c9 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.038412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6620c8fa-0a26-4152-9c85-8908649b078a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.039783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c8fa-0a26-4152-9c85-8908649b078a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.040246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c8fa-0a26-4152-9c85-8908649b078a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.040596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6620c8fa-0a26-4152-9c85-8908649b078a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.041301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620c8fa-0a26-4152-9c85-8908649b078a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:51.041439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd529153-8d32-42d2-af10-0d4f35a23bf3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.045754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6620c8fa-0a26-4152-9c85-8908649b078a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:51.065162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.065749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.066037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.067039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] PATH_INFO: `/v3/users/f637353bb71249e1b6dafff36a69bfe6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.074167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:51.075400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f637353bb71249e1b6dafff36a69bfe6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:51.081345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:51.113757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 881/1782] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:50 2022] POST /identity/v3/projects => generated 383 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:51.118800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.118800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.119058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.193820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:51.196511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.243317 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f637353bb71249e1b6dafff36a69bfe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:51.245038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f637353bb71249e1b6dafff36a69bfe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:51.275542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f637353bb71249e1b6dafff36a69bfe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:51.287259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f637353bb71249e1b6dafff36a69bfe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:51.324315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7247c896-5a48-4d45-b81e-363646b55b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f637353bb71249e1b6dafff36a69bfe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:51.360681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 902/1783] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:50 2022] DELETE /identity/v3/users/f637353bb71249e1b6dafff36a69bfe6 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:51.365648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.369513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.369829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.427975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 882/1784] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:51.429039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:51.435308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.443967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] MFA Rules not processed for user `67d1de462c2a40be909e32e1846d77ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:51.445260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.474360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eb7292-981a-4dbb-a98b-c0c5b47458fa None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.632994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 903/1785] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:51.634217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e978c9cf-134c-4068-98ab-a70e2aa2e90b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.634855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:51.634962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978c9cf-134c-4068-98ab-a70e2aa2e90b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.635307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978c9cf-134c-4068-98ab-a70e2aa2e90b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.635649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e978c9cf-134c-4068-98ab-a70e2aa2e90b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.637525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978c9cf-134c-4068-98ab-a70e2aa2e90b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:51.638960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e978c9cf-134c-4068-98ab-a70e2aa2e90b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:51.639237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.715396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:51.745304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc270739-9bbb-4f10-8359-0e2cf461045f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.747529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 883/1786] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/users => generated 298 bytes in 319 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:51.749405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.749699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.749976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.771218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.772257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.774159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.775130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.781865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.824703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:51.825929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:51.855545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 884/1787] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:51.855545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:51.874103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b98c8b-f143-4715-82c7-892ff45e46f3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.893633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.894261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.894539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.894809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.895461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:51.897114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:51.925258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 885/1788] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:51 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:51.926243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:51.949461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29aed6a4-1094-4dbe-ba1d-b89f3b975603 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:51.967557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:51.968218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.968498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.968768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:51.969424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:51.969740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:51.976431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8661865a-6406-49b8-b0f3-666303d91b9e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:51.989927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:51.989927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:51.998024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 886/1789] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:51.999313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:51.999593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:51.999859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.026670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 904/1790] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:51 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:52.027428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.044301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ea1f6-9723-4330-a9d3-1709c170eeb5 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.053430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.054144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.054422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.054807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] PATH_INFO: `/v3/projects/3b4783a22bd84e4a96ed79d114dd7b8b/users/eee886591cb149dbadadd75e3a7835bb/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.057088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] MFA Rules not processed for user `ce7b1f7925614a2b9cf9d2c7eaf2b7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:52.058439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:52.093000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4783a22bd84e4a96ed79d114dd7b8b, user_id=eee886591cb149dbadadd75e3a7835bb, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.096272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.121737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 905/1791] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:52 2022] PUT /identity/v3/projects/3b4783a22bd84e4a96ed79d114dd7b8b/users/eee886591cb149dbadadd75e3a7835bb/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:52.121737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.239544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.268830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 887/1792] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:51 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:52.270098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.298049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9acaa-8111-41b3-9403-7fc8715e65b4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.317209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.317862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.320787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.321166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b996ae7-8eba-408c-ab93-8577fa4a07d0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.322287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.324645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.331352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.350000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.350718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.351012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.359432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.362613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.365940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.370182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 888/1793] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:52.380903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.417057 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e338256b-6be9-41ce-8797-cfba8153aa79 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.440518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1202270c-0120-4765-8cca-dc8920637b5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.444310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202270c-0120-4765-8cca-dc8920637b5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.444598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202270c-0120-4765-8cca-dc8920637b5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.444885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1202270c-0120-4765-8cca-dc8920637b5b admin admin] PATH_INFO: `/v3/projects/3b4783a22bd84e4a96ed79d114dd7b8b/users/eee886591cb149dbadadd75e3a7835bb/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.455989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202270c-0120-4765-8cca-dc8920637b5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3b4783a22bd84e4a96ed79d114dd7b8b, user_id=eee886591cb149dbadadd75e3a7835bb, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.469855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1202270c-0120-4765-8cca-dc8920637b5b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.514578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 906/1794] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/projects => generated 399 bytes in 395 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:52.525527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.540647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 889/1795] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:52 2022] PUT /identity/v3/projects/3b4783a22bd84e4a96ed79d114dd7b8b/users/eee886591cb149dbadadd75e3a7835bb/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:52.543056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.543340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.543664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.638487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] MFA Rules not processed for user `eee886591cb149dbadadd75e3a7835bb`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:52.640440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:52.712598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:52.717956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e695d541-cf3b-4a4b-9ea7-b01110b4de52 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.728146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.729794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.730300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.730809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.732237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.735619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.776240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 907/1796] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/users => generated 300 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:52.780321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.817264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ed41f6-5d90-4594-b0c8-60f8e7da38fd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.827423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 890/1797] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:52 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:52.832089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.832487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.832788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.833046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.833711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.835520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.839429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.851291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 908/1798] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:00:52.855931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:52.891839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f76bbc-1868-47ac-ab6f-e5d40a73f027 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.924593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.925325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.925771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.926389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.928660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.929619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a23f377-b9bf-4e35-9857-dee1feb4224f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:52.952547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.956076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:52.956782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:52.957069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:52.958176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:52.982931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:52.988789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:52.994615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 909/1799] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:52.997241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.027756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f90022-a938-4e2b-b5c8-124f29e1d993 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.028962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 891/1800] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:52 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:53.041847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033a6669-67bd-49e0-b742-27240c5f3102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.042661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a6669-67bd-49e0-b742-27240c5f3102 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.043010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a6669-67bd-49e0-b742-27240c5f3102 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.043370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033a6669-67bd-49e0-b742-27240c5f3102 admin admin] PATH_INFO: `/v3/projects/2933ff112e87496ba7c4efab7622f67f/users/54546ac77f1b472a86b59967bd45954e/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.074474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.076496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.085712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a6669-67bd-49e0-b742-27240c5f3102 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2933ff112e87496ba7c4efab7622f67f, user_id=54546ac77f1b472a86b59967bd45954e, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.089609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-033a6669-67bd-49e0-b742-27240c5f3102 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.107275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c061269c-4cb4-4098-babb-36fcdd8dfe00 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.114884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.115586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.116221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.116221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] PATH_INFO: `/v3/projects/2db2b184f9f14b62ac034dd6dce1004b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.118102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2db2b184f9f14b62ac034dd6dce1004b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.120204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.131770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 910/1801] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:52 2022] PUT /identity/v3/projects/2933ff112e87496ba7c4efab7622f67f/users/54546ac77f1b472a86b59967bd45954e/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:53.152630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dfa3f-c071-4c52-b77f-f9344a6d5192 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.152944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dfa3f-c071-4c52-b77f-f9344a6d5192 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.157393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162dfa3f-c071-4c52-b77f-f9344a6d5192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.222607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2db2b184f9f14b62ac034dd6dce1004b', 'request_id': 'req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:53.243880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2db2b184f9f14b62ac034dd6dce1004b', 'request_id': 'req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:53.245384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:53.268016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2db2b184f9f14b62ac034dd6dce1004b', 'request_id': 'req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:53.288411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-162dfa3f-c071-4c52-b77f-f9344a6d5192 None None] MFA Rules not processed for user `54546ac77f1b472a86b59967bd45954e`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:53.288411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-162dfa3f-c071-4c52-b77f-f9344a6d5192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.303605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] The token cache is being invalidate because project 2db2b184f9f14b62ac034dd6dce1004b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:00:53.303899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:53.308297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:53.313799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 892/1802] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:00:53 2022] DELETE /identity/v3/projects/2db2b184f9f14b62ac034dd6dce1004b => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:53.313799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.325657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.473734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365ce203-3eea-4e3e-9bfb-105f5b0e72e0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.482474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 911/1803] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 340 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:53.483796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a6c7-2d46-4c2b-adf0-d84779edf386 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.484096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a6c7-2d46-4c2b-adf0-d84779edf386 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.484375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a3a6c7-2d46-4c2b-adf0-d84779edf386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.501167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.501699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.502340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.502681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.508799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.565073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c1a3a6c7-2d46-4c2b-adf0-d84779edf386 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:53.566299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c1a3a6c7-2d46-4c2b-adf0-d84779edf386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.682037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.683619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.716674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 893/1804] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:53.717325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.723866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.752998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 912/1805] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:53.755677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.755964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.756259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.793657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e4b4b6-c77c-4b96-9025-3055fa02f5f0 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.806666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:53.807291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:53.807702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:53.808017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:53.808698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:53.810704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:53.818073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:53.819342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:53.853028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 913/1806] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:53.858431 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.879180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e30555-af96-4fc9-9aeb-e752aa3ac738 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:53.884275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 894/1807] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:53 2022] POST /identity/v3/projects => generated 401 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:53.890998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:53.964964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:54.185512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:54.188601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.189062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.190280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.192364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce61844-0f5d-4acd-b35d-d0d377adc0ca admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:54.192874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:00:54.193669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:54.196557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32a0a39-c9b3-4bf9-80d7-793ec7317aa1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.212252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:54.215341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.217256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.220387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.223454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:54.228954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 914/1808] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:00:54.232949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.233818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.237047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.237346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.327629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 895/1809] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:53 2022] POST /identity/v3/users => generated 307 bytes in 440 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:54.330853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:54.380995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f2665-d5ee-44ee-ace2-e283100d8b73 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:54.382483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:54.386731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:54.401015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:54.404165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.405226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.407177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.408076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:54.419368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.447249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:54.493669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 896/1810] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:54 2022] POST /identity/v3/projects => generated 369 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:54.494705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:54.646504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e29460-8cbb-4558-a50f-4e14ae33078c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:54.667373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:54.668401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.668843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.669328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.681312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:54.683875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.716186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 915/1811] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:00:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 474 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:54.716186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:54.717499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 897/1812] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:54.729392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:54.755861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3ba429-e135-43da-9991-f696d109cd50 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:54.767522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ebf4e-3e12-460f-a1f9-2bf186cc9959 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:54.775896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:54.778646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.778938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.779212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.782757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:54.784767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.785581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:54.786430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:54.787668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:54.788130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] PATH_INFO: `/v3/projects/6270fadcd26b4eddaaefc0dccdafa99d/users/5b1d45debf5840c99476a22bb1f36ab7/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:54.858980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6270fadcd26b4eddaaefc0dccdafa99d, user_id=5b1d45debf5840c99476a22bb1f36ab7, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:54.861885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:54.878296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 916/1813] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:54 2022] POST /identity/v3/users => generated 285 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:54.884599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:54.914225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 898/1814] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:54 2022] PUT /identity/v3/projects/6270fadcd26b4eddaaefc0dccdafa99d/users/5b1d45debf5840c99476a22bb1f36ab7/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:54.923386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:54.923945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0bc56d-f339-425e-bcf9-f2ae31193a2e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.118215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e420b59-6d5a-4683-889c-9ccc559cea51 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.129741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.130410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.136121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.137093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.137559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.137991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.138793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.139704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.140099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.143146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.143283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.144984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.176351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 899/1815] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:55.177921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.181835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:55.189075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 917/1816] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:54 2022] GET /identity/v3/roles => generated 1420 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:55.191309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.218469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a849af-f383-433d-b726-d0990e2a2935 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.234286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.235647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.235945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.236264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] PATH_INFO: `/v3/projects/6270fadcd26b4eddaaefc0dccdafa99d/users/5b1d45debf5840c99476a22bb1f36ab7/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.241800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6270fadcd26b4eddaaefc0dccdafa99d, user_id=5b1d45debf5840c99476a22bb1f36ab7, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.250068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.258438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.283449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 918/1817] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:55 2022] PUT /identity/v3/projects/6270fadcd26b4eddaaefc0dccdafa99d/users/5b1d45debf5840c99476a22bb1f36ab7/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:55.285803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.337349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:55.418665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e87538-b104-4c65-b2b3-595e72e2191f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.505210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abd958e-b609-4f8e-bb26-e117a4d1cde7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.541333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1aa969-6ac4-4a66-88a9-45aa8c7796fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.542842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aa969-6ac4-4a66-88a9-45aa8c7796fe admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.545230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aa969-6ac4-4a66-88a9-45aa8c7796fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.546923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1aa969-6ac4-4a66-88a9-45aa8c7796fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.547857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1aa969-6ac4-4a66-88a9-45aa8c7796fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.557984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1aa969-6ac4-4a66-88a9-45aa8c7796fe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.602401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.602679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 919/1818] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:55.603168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.604571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.604865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.606214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.607083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.608060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.720130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] MFA Rules not processed for user `5b1d45debf5840c99476a22bb1f36ab7`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:55.721444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:55.772154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.778728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:55.832342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 900/1819] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:00:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:00:55.837420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:55.870941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957d137e-8913-4206-9c63-e69407f82689 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:55.886163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7208b4b9-ef5c-4d96-a30c-475e00e97179 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:55.887899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208b4b9-ef5c-4d96-a30c-475e00e97179 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:55.887899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208b4b9-ef5c-4d96-a30c-475e00e97179 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:55.887899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7208b4b9-ef5c-4d96-a30c-475e00e97179 admin admin] PATH_INFO: `/v3/projects/7fcb5b46062e47ab81f85ad68be18327/users/00d47e89abdd48c0bdead483cb57e370/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:55.937540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208b4b9-ef5c-4d96-a30c-475e00e97179 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fcb5b46062e47ab81f85ad68be18327, user_id=00d47e89abdd48c0bdead483cb57e370, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:55.944351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7208b4b9-ef5c-4d96-a30c-475e00e97179 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.007223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 901/1820] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:55 2022] PUT /identity/v3/projects/7fcb5b46062e47ab81f85ad68be18327/users/00d47e89abdd48c0bdead483cb57e370/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:56.019546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.019864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.020163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.120268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 920/1821] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:55 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 515 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:56.126036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] MFA Rules not processed for user `00d47e89abdd48c0bdead483cb57e370`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:56.135389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:56.324476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.419314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 902/1822] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 401 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:56.422559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.424904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.426982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:56.448926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dfc6296-43d6-4c52-9baa-aa2b1ac3b10b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.596530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a458829-ac8f-41a1-b1bd-ed8271f27ce9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.609482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.611286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.613396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.614193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.614613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.615374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.615907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.616538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.618008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.621090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.701044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 921/1823] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:00:56 2022] POST /identity/v3/projects => generated 367 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:56.704937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.712052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:56.819122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a72e7a-dc04-4576-8554-792ce1560f42 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.827335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.828589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.829054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.829533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.830673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.833251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:56.887009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 922/1824] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:00:56 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:00:56.889141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:56.955883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b6e0ee-bf17-4cfd-b3ea-49cb0c701b56 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:56.982215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:56.985249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:56.989182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:56.990611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:56.993443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:56.996718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.024558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 923/1825] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/roles => generated 1420 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:57.038837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.046110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.057100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.093832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763f6766-7f22-4d80-9986-3e4cdf68d5cc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.106358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 903/1826] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:56 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 681 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:00:57.135459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.140345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.141056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.143205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] PATH_INFO: `/v3/projects/8225a0397ca44123b75a3a3952be8297/users/fee90838ed2b49e8b45d6b562479573a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.225464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8225a0397ca44123b75a3a3952be8297, user_id=fee90838ed2b49e8b45d6b562479573a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.235240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.313831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 924/1827] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:57 2022] PUT /identity/v3/projects/8225a0397ca44123b75a3a3952be8297/users/fee90838ed2b49e8b45d6b562479573a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:57.316461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.341599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36748c9c-f3d0-42ee-acef-79947c2fe2ed service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.593302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:57.702351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6451784-7e00-461a-afc2-6e3274dd2e3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.702960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6451784-7e00-461a-afc2-6e3274dd2e3c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.703840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6451784-7e00-461a-afc2-6e3274dd2e3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.703840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6451784-7e00-461a-afc2-6e3274dd2e3c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.707611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6451784-7e00-461a-afc2-6e3274dd2e3c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:57.711746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6451784-7e00-461a-afc2-6e3274dd2e3c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:57.741006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 904/1828] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/roles => generated 1420 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:00:57.742825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.747817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.748136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.814303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:57.818224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:57.898734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:57.926280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56462a59-2c61-4d60-99a2-ae24d7938cc3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:57.962014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:57.962810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:57.963133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:57.963385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:57.990489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 905/1829] 10.222.0.73 () {58 vars in 1015 bytes} [Thu Aug 25 03:00:57 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:57.991725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.074415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12924886-d4ea-48fa-99e1-b2611569f1fd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.086573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6152425-d777-4f45-91ef-7af85e22586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.088303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6152425-d777-4f45-91ef-7af85e22586f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.089242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6152425-d777-4f45-91ef-7af85e22586f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.089973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6152425-d777-4f45-91ef-7af85e22586f admin admin] PATH_INFO: `/v3/projects/8225a0397ca44123b75a3a3952be8297/users/fee90838ed2b49e8b45d6b562479573a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.094227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6152425-d777-4f45-91ef-7af85e22586f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8225a0397ca44123b75a3a3952be8297, user_id=fee90838ed2b49e8b45d6b562479573a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.098599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6152425-d777-4f45-91ef-7af85e22586f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.136795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 906/1830] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:00:57 2022] PUT /identity/v3/projects/8225a0397ca44123b75a3a3952be8297/users/fee90838ed2b49e8b45d6b562479573a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:58.155448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.156739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.157030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.180981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.185727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.208128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 925/1831] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:57 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 615 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:00:58.351798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] MFA Rules not processed for user `fee90838ed2b49e8b45d6b562479573a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:58.352627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.354479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:58.363816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:58.406532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b881f698-d19b-4b41-90a0-45bf6cc1dab3 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.428865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:00:58.608600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 907/1832] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:00:58.646584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.648619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.650025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.651029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:58.673213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:58.678018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:58.703183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 926/1833] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:00:58.788222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:58.929536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96adc8a-e706-4cb3-bab8-f2138fb600cc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:58.959125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c078bb73-9fda-40b7-9143-d55f20064b99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:58.960087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078bb73-9fda-40b7-9143-d55f20064b99 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:58.960355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078bb73-9fda-40b7-9143-d55f20064b99 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:58.960630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c078bb73-9fda-40b7-9143-d55f20064b99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.015194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078bb73-9fda-40b7-9143-d55f20064b99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.026072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c078bb73-9fda-40b7-9143-d55f20064b99 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.072498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 908/1834] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:00:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:00:59.247174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:00:59.249101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:00:59.509569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebf3de4-a8c6-4459-8644-e3a518c0f8d6 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:00:59.523232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:00:59.524288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.524845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.525157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] PATH_INFO: `/v3/users/2e1ad69f89c64966990ef6f68d8afa71` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.527447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e1ad69f89c64966990ef6f68d8afa71)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:00:59.531355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:00:59.696471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e1ad69f89c64966990ef6f68d8afa71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:59.697571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e1ad69f89c64966990ef6f68d8afa71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:59.720724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e1ad69f89c64966990ef6f68d8afa71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:59.740917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e1ad69f89c64966990ef6f68d8afa71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:59.770198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e1ad69f89c64966990ef6f68d8afa71'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:00:59.800809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 927/1835] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:00:59 2022] DELETE /identity/v3/users/2e1ad69f89c64966990ef6f68d8afa71 => generated 0 bytes in 552 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:00:59.803035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200be2-d4c2-4d50-a10d-373e339cb670 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:00:59.803554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200be2-d4c2-4d50-a10d-373e339cb670 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:00:59.803832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51200be2-d4c2-4d50-a10d-373e339cb670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:00:59.864679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-51200be2-d4c2-4d50-a10d-373e339cb670 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:00:59.871451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-51200be2-d4c2-4d50-a10d-373e339cb670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:00.050121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.090895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 909/1836] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:00:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:00.172419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:00.173912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:00.287308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:00.345808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-472c5572-2db2-44d8-9873-d60f9d01ffeb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:00.357165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bdbb86-0ede-4b2a-9f92-28eba65c50a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:00.358234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdbb86-0ede-4b2a-9f92-28eba65c50a5 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:00.358849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdbb86-0ede-4b2a-9f92-28eba65c50a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:00.359591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bdbb86-0ede-4b2a-9f92-28eba65c50a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:00.391699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdbb86-0ede-4b2a-9f92-28eba65c50a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:00.393534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50bdbb86-0ede-4b2a-9f92-28eba65c50a5 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:00.421924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 928/1837] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:01.998840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dd5be-a1e8-4c74-ad4a-1ff306ab0237 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.000283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dd5be-a1e8-4c74-ad4a-1ff306ab0237 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.000772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21dd5be-a1e8-4c74-ad4a-1ff306ab0237 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.003249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 910/1838] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:01:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:02.538817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.539963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.540109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.600093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:02.602472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:02.896992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbdda5-67cc-4b7a-bb71-711131c396c5 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.898427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbdda5-67cc-4b7a-bb71-711131c396c5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.899257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddbdda5-67cc-4b7a-bb71-711131c396c5 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:02.901825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 911/1839] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:01:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 25 03:01:02.908637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 929/1840] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:01:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 371 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:02.975304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:02.975538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:02.977315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.008758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:03.012576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:03.035863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 912/1841] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:01:02 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:03.263203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.271946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:03.324810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e95fdd-0968-4743-b42e-5283f4bfad0a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.347381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.348542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.349750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.350033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.402127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.408322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.468820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 930/1842] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:03.546169 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.547821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:03.573237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af936df-5479-4f93-aaaf-6f5d4475311d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.590537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.594768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.595281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.596679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] PATH_INFO: `/v3/projects/a768f79f2b6c4c7690fcd4afaca77c91` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.606159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a768f79f2b6c4c7690fcd4afaca77c91)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.610967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.707681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.731285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61301750-b8fd-4b7a-a95d-05d60468d0f2 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:03.750579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a768f79f2b6c4c7690fcd4afaca77c91', 'request_id': 'req-95ab915f-369d-4124-bc32-a593edb05ed1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:03.778713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a768f79f2b6c4c7690fcd4afaca77c91', 'request_id': 'req-95ab915f-369d-4124-bc32-a593edb05ed1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:03.806171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a768f79f2b6c4c7690fcd4afaca77c91', 'request_id': 'req-95ab915f-369d-4124-bc32-a593edb05ed1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:03.842827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] The token cache is being invalidate because project a768f79f2b6c4c7690fcd4afaca77c91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:03.844456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:03.846329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:03.854244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 913/1843] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:03 2022] DELETE /identity/v3/projects/a768f79f2b6c4c7690fcd4afaca77c91 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:03.855895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:03.860904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:03.917302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:03.918298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:03.919272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:03.919555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:03.921988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:03.938902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:03.940792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:03.956191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 931/1844] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:03 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:03.998348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:04.000013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:04.089296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ab915f-369d-4124-bc32-a593edb05ed1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:04.102462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:04.103122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:04.103389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:04.103813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] PATH_INFO: `/v3/users/eee886591cb149dbadadd75e3a7835bb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:04.108710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eee886591cb149dbadadd75e3a7835bb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:04.117493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:04.161676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:04.269304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eee886591cb149dbadadd75e3a7835bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.278274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eee886591cb149dbadadd75e3a7835bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.278375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e751b67-f142-46dd-9241-bc820f63c583 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:04.292064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:04.294409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:04.294703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:04.295044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] PATH_INFO: `/v3/users/54546ac77f1b472a86b59967bd45954e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:04.298569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] RBAC: Authorizing `identity:delete_user(user_id=54546ac77f1b472a86b59967bd45954e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:04.305598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:04.327621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eee886591cb149dbadadd75e3a7835bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.341865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eee886591cb149dbadadd75e3a7835bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.346528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:04.367433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e6cae4d-d863-4d8a-a945-3af1d79b6ab8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eee886591cb149dbadadd75e3a7835bb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.387296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 914/1845] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:03 2022] DELETE /identity/v3/users/eee886591cb149dbadadd75e3a7835bb => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:04.441063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54546ac77f1b472a86b59967bd45954e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.446170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54546ac77f1b472a86b59967bd45954e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.467843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54546ac77f1b472a86b59967bd45954e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.479235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54546ac77f1b472a86b59967bd45954e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.511396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54546ac77f1b472a86b59967bd45954e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:04.531472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 932/1846] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:03 2022] DELETE /identity/v3/users/54546ac77f1b472a86b59967bd45954e => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:04.535774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:04.536503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:04.537770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:04.543331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:04.545155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:04.576174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:04.580817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:04.714521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 915/1847] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:04.751725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:04.753750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:04.800467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65294838-d0b9-4a15-9424-b7a2708c456f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:04.813613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:04.816472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:04.817345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:04.818023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] PATH_INFO: `/v3/users/00d47e89abdd48c0bdead483cb57e370` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:04.820907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=00d47e89abdd48c0bdead483cb57e370)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:04.824630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:04.933355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9de9c7-6007-4aee-996b-c593feb54940 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:04.961706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a5f598-e4ca-4274-b6e3-725a90c87fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:04.962322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f598-e4ca-4274-b6e3-725a90c87fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:04.962590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f598-e4ca-4274-b6e3-725a90c87fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:04.963183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a5f598-e4ca-4274-b6e3-725a90c87fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:05.013533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00d47e89abdd48c0bdead483cb57e370'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:05.017500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00d47e89abdd48c0bdead483cb57e370'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:05.025856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f598-e4ca-4274-b6e3-725a90c87fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:05.032085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a5f598-e4ca-4274-b6e3-725a90c87fd6 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:05.048001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00d47e89abdd48c0bdead483cb57e370'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:05.068668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:05.076925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 916/1848] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:05.078602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00d47e89abdd48c0bdead483cb57e370'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:05.112018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00d47e89abdd48c0bdead483cb57e370'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:05.150396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 933/1849] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:04 2022] DELETE /identity/v3/users/00d47e89abdd48c0bdead483cb57e370 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:05.150558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:05.151044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:05.151145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:05.203564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:05.213016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:05.425944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 917/1850] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 276 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:05.443970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:05.446225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:05.519677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bf806f-9d21-458f-bee0-31e20be17da7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:05.524437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c068e1-a1ff-4729-b5d9-023b70d10ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:05.525193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c068e1-a1ff-4729-b5d9-023b70d10ebd service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:05.525474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c068e1-a1ff-4729-b5d9-023b70d10ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:05.525758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c068e1-a1ff-4729-b5d9-023b70d10ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:05.538565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c068e1-a1ff-4729-b5d9-023b70d10ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:05.540825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c068e1-a1ff-4729-b5d9-023b70d10ebd service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:05.553316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 934/1851] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:06.715170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:06.717595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:06.744741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba87e3b-ab5a-43c0-b7f3-a5a97af0b76e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:06.754636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:06.756738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:06.758386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:06.759633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] PATH_INFO: `/v3/projects/3b4783a22bd84e4a96ed79d114dd7b8b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:06.777405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3b4783a22bd84e4a96ed79d114dd7b8b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:06.783606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:06.875399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:06.895975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3b4783a22bd84e4a96ed79d114dd7b8b', 'request_id': 'req-1c555d9e-03c6-4b6c-aa97-e35ee9265095'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:06.906313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3b4783a22bd84e4a96ed79d114dd7b8b', 'request_id': 'req-1c555d9e-03c6-4b6c-aa97-e35ee9265095'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:06.930964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3b4783a22bd84e4a96ed79d114dd7b8b', 'request_id': 'req-1c555d9e-03c6-4b6c-aa97-e35ee9265095'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:06.951888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] The token cache is being invalidate because project 3b4783a22bd84e4a96ed79d114dd7b8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:06.952530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:06.954564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1c555d9e-03c6-4b6c-aa97-e35ee9265095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:06.961405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 918/1852] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:06 2022] DELETE /identity/v3/projects/3b4783a22bd84e4a96ed79d114dd7b8b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:06.963092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:06.963649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:06.963884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.001387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:07.002634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:07.232603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 935/1853] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:07.244635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.244932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.245276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.254349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:07.282553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:07.314254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:07.322141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:07.324514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a549f4-eedf-4deb-90bb-b9508d49ffd6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:07.350070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:07.354664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.354957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.355248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] PATH_INFO: `/v3/projects/7fcb5b46062e47ab81f85ad68be18327` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.364405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fcb5b46062e47ab81f85ad68be18327)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:07.369297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 919/1854] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:07.374266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:07.374730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:07.405592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e06464-149f-423a-82e7-d351c52b3590 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:07.422903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:07.423713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.424143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.425348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.427444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:07.428117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:07.433375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:07.471537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 920/1855] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:07.473606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:07.497603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df179114-2837-4f68-911f-9bc404c8519c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:07.550627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fcb5b46062e47ab81f85ad68be18327', 'request_id': 'req-7c173290-a107-454a-8045-beb06e90505f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:07.575917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fcb5b46062e47ab81f85ad68be18327', 'request_id': 'req-7c173290-a107-454a-8045-beb06e90505f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:07.591113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fcb5b46062e47ab81f85ad68be18327', 'request_id': 'req-7c173290-a107-454a-8045-beb06e90505f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:07.592336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:07.594457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.594749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.595081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.595781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:07.599003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:07.621933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] The token cache is being invalidate because project 7fcb5b46062e47ab81f85ad68be18327 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:07.622690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:07.623820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:07.630436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 936/1856] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:07 2022] DELETE /identity/v3/projects/7fcb5b46062e47ab81f85ad68be18327 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:07.633798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:07.635329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:07.657541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 921/1857] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:07 2022] POST /identity/v3/projects => generated 361 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:07.659362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:07.661583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c173290-a107-454a-8045-beb06e90505f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:07.662603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:07.663152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:07.781459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d12f29b-fc37-4cb2-8576-5e71a3a78f9a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:07.797216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:07.798255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.798630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.799204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.799849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:07.802970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:07.823927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:07.824950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.825518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.826121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] PATH_INFO: `/v3/users/fee90838ed2b49e8b45d6b562479573a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.829386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=fee90838ed2b49e8b45d6b562479573a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:07.832347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:07.851366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 922/1858] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:07 2022] POST /identity/v3/users => generated 281 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:07.853333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:07.857968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:07.891944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b433d7e-9c2f-4c5e-8509-ff3407660bdb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:07.902481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:07.903429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:07.904012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:07.904862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] PATH_INFO: `/v3/projects/2933ff112e87496ba7c4efab7622f67f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:07.906330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2933ff112e87496ba7c4efab7622f67f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:07.914920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:07.963679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:08.021344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fee90838ed2b49e8b45d6b562479573a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.027373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fee90838ed2b49e8b45d6b562479573a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.056473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fee90838ed2b49e8b45d6b562479573a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.070988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fee90838ed2b49e8b45d6b562479573a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.085135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2933ff112e87496ba7c4efab7622f67f', 'request_id': 'req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.102171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2933ff112e87496ba7c4efab7622f67f', 'request_id': 'req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.123045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2933ff112e87496ba7c4efab7622f67f', 'request_id': 'req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.143869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fee90838ed2b49e8b45d6b562479573a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.153278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 937/1859] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:07 2022] DELETE /identity/v3/users/fee90838ed2b49e8b45d6b562479573a => generated 0 bytes in 521 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:08.154740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.155287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] The token cache is being invalidate because project 2933ff112e87496ba7c4efab7622f67f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:08.155765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.169022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.171383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 923/1860] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:07 2022] DELETE /identity/v3/projects/2933ff112e87496ba7c4efab7622f67f => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:08.175345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:08.176354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.179912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:08.328864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3811d3ce-7b01-4bfa-a75e-7a66b6ebbd5b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.395986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e4d226-0e30-460e-b990-8a36c9fa6c5c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.410834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.411500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.411791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.412149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.412845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.414752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.439935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 938/1861] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:08.440941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.449951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:08.477870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b87801-fe36-48dd-b08a-9f6ee8130759 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.490941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.492082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.492370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.492695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.493532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.495211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.499649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.500386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.500912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.501240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] PATH_INFO: `/v3/users/5b1d45debf5840c99476a22bb1f36ab7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.502731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b1d45debf5840c99476a22bb1f36ab7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.509386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.525281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 939/1862] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:08.531706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.553518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e17f88-43e7-4411-809c-296ccbcc10da admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:08.569646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae9fa7e-6573-49aa-b9a8-cdd6b93d5571 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:08.570145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9fa7e-6573-49aa-b9a8-cdd6b93d5571 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.570785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9fa7e-6573-49aa-b9a8-cdd6b93d5571 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.571131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae9fa7e-6573-49aa-b9a8-cdd6b93d5571 admin admin] PATH_INFO: `/v3/projects/7375a31756924568bb9dd8153587f257/users/ec4819733de64703a9e5bac542ed2977/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.580096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:08.597039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:08.599694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b1d45debf5840c99476a22bb1f36ab7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.602104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b1d45debf5840c99476a22bb1f36ab7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.621318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9fa7e-6573-49aa-b9a8-cdd6b93d5571 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7375a31756924568bb9dd8153587f257, user_id=ec4819733de64703a9e5bac542ed2977, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:08.630030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae9fa7e-6573-49aa-b9a8-cdd6b93d5571 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:08.635856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b1d45debf5840c99476a22bb1f36ab7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.663675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b1d45debf5840c99476a22bb1f36ab7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.676104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 940/1863] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:08 2022] PUT /identity/v3/projects/7375a31756924568bb9dd8153587f257/users/ec4819733de64703a9e5bac542ed2977/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:08.683170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:08.683460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:08.683730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:08.689607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b1d45debf5840c99476a22bb1f36ab7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:08.711670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 924/1864] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:08 2022] DELETE /identity/v3/users/5b1d45debf5840c99476a22bb1f36ab7 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:08.729276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] MFA Rules not processed for user `ec4819733de64703a9e5bac542ed2977`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:08.730607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:08.860438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 941/1865] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:08 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:08.890595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:08.892092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.039699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1454be7a-a196-4c39-b5e2-8f5acd962a1a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.044579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.045995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.046534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.046923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.060603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.062306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.080252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 925/1866] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:08 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:09.097955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.099823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.102298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.105170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.218277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e7c4ca-37c3-454d-aa44-d71fdc24e340 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.231486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.232852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.233654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.233994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] PATH_INFO: `/v3/projects/8225a0397ca44123b75a3a3952be8297` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.235847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8225a0397ca44123b75a3a3952be8297)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.238600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.274976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bbb61d-74b8-48ba-9227-8a27e99353e9 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.283706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.285593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.286470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.286839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] PATH_INFO: `/v3/users/ec4819733de64703a9e5bac542ed2977` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.288987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec4819733de64703a9e5bac542ed2977)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.293163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.335744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8225a0397ca44123b75a3a3952be8297', 'request_id': 'req-de2ef24b-ca47-469d-8c69-c6b479436b72'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.343922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8225a0397ca44123b75a3a3952be8297', 'request_id': 'req-de2ef24b-ca47-469d-8c69-c6b479436b72'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.358656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8225a0397ca44123b75a3a3952be8297', 'request_id': 'req-de2ef24b-ca47-469d-8c69-c6b479436b72'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.366134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec4819733de64703a9e5bac542ed2977'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.367893 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec4819733de64703a9e5bac542ed2977'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.373367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] The token cache is being invalidate because project 8225a0397ca44123b75a3a3952be8297 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:09.373688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.374471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.376397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 942/1867] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:09 2022] DELETE /identity/v3/projects/8225a0397ca44123b75a3a3952be8297 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:09.377556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.378605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.387348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.395411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec4819733de64703a9e5bac542ed2977'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.403868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.413008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec4819733de64703a9e5bac542ed2977'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.429810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-775f08fb-90a9-4d0c-9e43-09261cc0015a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec4819733de64703a9e5bac542ed2977'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.443176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 926/1868] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:09 2022] DELETE /identity/v3/users/ec4819733de64703a9e5bac542ed2977 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:09.448270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944b99-aed5-4ec7-8b15-7845fd2c793a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.449154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944b99-aed5-4ec7-8b15-7845fd2c793a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.449952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5944b99-aed5-4ec7-8b15-7845fd2c793a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.494059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a5944b99-aed5-4ec7-8b15-7845fd2c793a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:09.496569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a5944b99-aed5-4ec7-8b15-7845fd2c793a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.502244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2ef24b-ca47-469d-8c69-c6b479436b72 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.603796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.604440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.604725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.604997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] PATH_INFO: `/v3/projects/6270fadcd26b4eddaaefc0dccdafa99d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.606188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6270fadcd26b4eddaaefc0dccdafa99d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.608243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.624574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 927/1869] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:09.626565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588831-88fb-4fe4-9005-4e359634d0d4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.627224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588831-88fb-4fe4-9005-4e359634d0d4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.636212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6588831-88fb-4fe4-9005-4e359634d0d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.665705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b6588831-88fb-4fe4-9005-4e359634d0d4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:09.666917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6588831-88fb-4fe4-9005-4e359634d0d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.681459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 928/1870] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:09.683184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7bd0-5ed6-44ee-bb6a-b603f9b0c12d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.683474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7bd0-5ed6-44ee-bb6a-b603f9b0c12d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.683746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52bd7bd0-5ed6-44ee-bb6a-b603f9b0c12d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.698249 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6270fadcd26b4eddaaefc0dccdafa99d', 'request_id': 'req-dab80726-4abb-4d5f-9e67-3b7661b8cd82'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.708096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6270fadcd26b4eddaaefc0dccdafa99d', 'request_id': 'req-dab80726-4abb-4d5f-9e67-3b7661b8cd82'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.708367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-52bd7bd0-5ed6-44ee-bb6a-b603f9b0c12d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:09.709023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-52bd7bd0-5ed6-44ee-bb6a-b603f9b0c12d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.714521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6270fadcd26b4eddaaefc0dccdafa99d', 'request_id': 'req-dab80726-4abb-4d5f-9e67-3b7661b8cd82'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.727973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] The token cache is being invalidate because project 6270fadcd26b4eddaaefc0dccdafa99d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:09.728298 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.728991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:09.731050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 943/1871] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:09 2022] DELETE /identity/v3/projects/6270fadcd26b4eddaaefc0dccdafa99d => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:09.732866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.735184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.774784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 929/1872] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:09.778167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.778167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.778167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.796763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:09.800454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:09.801602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.811597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 930/1873] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:09.812333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.821592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab80726-4abb-4d5f-9e67-3b7661b8cd82 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.823030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7da6a0-5c4f-41ec-ae76-6ca7f1c9999f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.826170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.826820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.827105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.827410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.827946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.828725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.829007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.829269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.829377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.829912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:09.830208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.831783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e9527-b61b-4f80-9ebc-95796e8baca2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.844023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.847973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 931/1874] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:09.848171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.848275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.848275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.848275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.857400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 944/1875] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:09.858000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.866793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:09.867988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:09.868861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7b189a-c33f-4420-86c1-239580aad129 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.874222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.875540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.876035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.876433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.876562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 932/1876] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:09.877244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.880082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.880693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.891517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f158a4c-9bd9-4d24-af92-805b7edc400c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.899190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:09.900322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:09.900706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:09.901062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:09.901882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:09.902164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:09.904079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:09.918663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 933/1877] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:09.919478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 945/1878] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/projects => generated 379 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:09.922942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.928251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:09.938991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aee4d8-ce95-4799-a12b-3c9e510359f5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:09.993328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=1,keystone:SELECT=99 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.027446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.028102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.028369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.028644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.029448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.031479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.032492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddac948-9386-4d0c-bb7e-ece088b7b3ab admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.057613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.057613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.057613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.059280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.059874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.061927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.093258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 934/1879] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/projects => generated 377 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:10.099982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 946/1880] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:09 2022] POST /identity/v3/users => generated 290 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:10.101217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.101695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.119283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f230590b-a753-40db-ad74-dc3cf0cf79eb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.204745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d74eda9-4a34-42f6-b8b3-59c29e4fa8a5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.211964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.212628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.212907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.213794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.214683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.216711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.223076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.224195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.224782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.225371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.226929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.230350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.252367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 935/1882] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/users => generated 289 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:10.252679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 947/1882] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:10.252761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.254679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.268612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e5eed4-93ed-4b1a-b946-e0636a7aea88 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.279419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.280659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.281041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.281342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.281997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.284530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.296575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f551c2-41cb-4e45-8d2b-7ea5c8004e76 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.300079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 936/1883] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:10.302442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.309405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.310638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.310996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.311288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.312001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.315937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c29b8d4-b789-484c-a0fa-dfee5b10772d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.318359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.321348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.321953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.322442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.322820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.323896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.326081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.339518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 948/1884] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:10.340907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.347865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 937/1885] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:10.348025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.348155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.361264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bae1b27-7c63-4682-b10c-4520bc584840 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.365606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab5c50a-d6a8-44b9-ac3e-280d7dff0376 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.368018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.368935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.369229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.369584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] PATH_INFO: `/v3/projects/7375a31756924568bb9dd8153587f257` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.370881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7375a31756924568bb9dd8153587f257)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.373009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.373818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.374164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.374557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] PATH_INFO: `/v3/projects/706a71aa5d774e24a5d46907e808bbd8/users/daa5bf4a700741bba540cc590cba32c2/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.377991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.394508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=706a71aa5d774e24a5d46907e808bbd8, user_id=daa5bf4a700741bba540cc590cba32c2, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.398159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.418798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 938/1886] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:10 2022] PUT /identity/v3/projects/706a71aa5d774e24a5d46907e808bbd8/users/daa5bf4a700741bba540cc590cba32c2/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:10.419698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.454842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.484495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7375a31756924568bb9dd8153587f257', 'request_id': 'req-3eb0fdc3-a373-4702-8f11-c201b8238ef2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:10.491404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7375a31756924568bb9dd8153587f257', 'request_id': 'req-3eb0fdc3-a373-4702-8f11-c201b8238ef2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:10.516422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7375a31756924568bb9dd8153587f257', 'request_id': 'req-3eb0fdc3-a373-4702-8f11-c201b8238ef2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:10.523612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf3b33a-8b2d-4cb3-8e90-bc33d374bf37 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.529472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] The token cache is being invalidate because project 7375a31756924568bb9dd8153587f257 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:10.529769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:10.530441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3eb0fdc3-a373-4702-8f11-c201b8238ef2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:10.532082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 949/1887] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:10 2022] DELETE /identity/v3/projects/7375a31756924568bb9dd8153587f257 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:10.533372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc89a-509a-4acc-99cd-84d5da7c7aed None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.533684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc89a-509a-4acc-99cd-84d5da7c7aed None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.533961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123cc89a-509a-4acc-99cd-84d5da7c7aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.538934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.567071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-123cc89a-509a-4acc-99cd-84d5da7c7aed None None] MFA Rules not processed for user `daa5bf4a700741bba540cc590cba32c2`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:10.568941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-123cc89a-509a-4acc-99cd-84d5da7c7aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.617740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.618830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.619112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.619391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] PATH_INFO: `/v3/projects/1933c077bb20456b80f42cf51f6fb4d4/users/fad869067cb54c25b4a5713a122e6c4f/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.637916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1933c077bb20456b80f42cf51f6fb4d4, user_id=fad869067cb54c25b4a5713a122e6c4f, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.640797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.646549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 950/1888] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:10.647982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f50d8-c3f4-422e-b215-265e2506ce19 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.648300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f50d8-c3f4-422e-b215-265e2506ce19 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.648597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5f50d8-c3f4-422e-b215-265e2506ce19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.661848 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 939/1889] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:10 2022] PUT /identity/v3/projects/1933c077bb20456b80f42cf51f6fb4d4/users/fad869067cb54c25b4a5713a122e6c4f/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:10.663645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.665392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.675348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ec5f50d8-c3f4-422e-b215-265e2506ce19 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:10.676595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ec5f50d8-c3f4-422e-b215-265e2506ce19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.738523 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e5244c-4be1-4e61-9ce6-1ed1bec87655 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.740269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 951/1890] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:10.742216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.742500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.743075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.744477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3377feb8-f78e-4ad2-a457-5d4867ecbf7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.745158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377feb8-f78e-4ad2-a457-5d4867ecbf7f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.745508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377feb8-f78e-4ad2-a457-5d4867ecbf7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.745871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3377feb8-f78e-4ad2-a457-5d4867ecbf7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.746570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377feb8-f78e-4ad2-a457-5d4867ecbf7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.748928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3377feb8-f78e-4ad2-a457-5d4867ecbf7f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.776363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] MFA Rules not processed for user `fad869067cb54c25b4a5713a122e6c4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:10.777781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.782942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 940/1891] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/projects => generated 381 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:10.782942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.782942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.782942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.801447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:10.802757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.821008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.847567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 952/1892] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:10.848418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.865417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 941/1893] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:10.866328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.868328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:10.879999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a8e612-628b-4576-ab82-3d2cf94cf207 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.885105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.885696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.885974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.886397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.887014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.888939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.918494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 942/1894] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:10.918494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:10.920691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23edbad-d7bf-4263-8114-7cdc53f98159 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.921697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:10.983851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.985008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.985293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.985706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.986472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:10.988635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:10.990563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a499865-7502-4638-aec8-bbad9149c065 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:10.996490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:10.997229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:10.997525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:10.998054 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:10.998432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:10.998726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.000643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.013281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 943/1895] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:11.014305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.019252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 953/1896] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:10 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:11.020079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.027869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ba62da-7094-48d8-b6f9-951ec3e42379 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.031839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bcfea2-3e4a-412b-9eb5-43156c32105d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.032779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.033385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.033662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.033932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.034610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.036507 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.037221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.037922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.038272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.039150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.040057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.042173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.060812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 944/1897] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/users => generated 289 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:11.061814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.072241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc28b20-89c3-496d-abda-5b0def49e9ee admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.077216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.077399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 954/1898] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:11.077820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.078325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.078707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.078878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.079377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.081178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.098559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 945/1899] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:11.098559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.109662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb69823-aa34-46c2-986a-a29d2e465d99 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.152695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:11.162760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3be8e99-a4d8-4505-a20c-0efa021e6a6f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.170080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.171002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.171462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.171567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.172229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.173843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.182731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.183340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.183668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.183945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.184889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.186838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.187685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 955/1900] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:11.188534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.198285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56be78e2-f64b-408b-981f-34bbfb3ec4a6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.205183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.205851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.206130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.206491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] PATH_INFO: `/v3/projects/be830e76028c42f8a7d75f568aefac17/users/170db83939024196a4ffbff3806ffc55/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.225490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] RBAC: Authorizing `identity:create_grant(project_id=be830e76028c42f8a7d75f568aefac17, user_id=170db83939024196a4ffbff3806ffc55, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.227545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 946/1901] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/users => generated 288 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:11.228580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.234827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.239765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c0f9c1-b64d-4d08-9e8a-7e398b1ec7c3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.249585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.250199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.250476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.252840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.253580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.256547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.264089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 956/1902] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:11 2022] PUT /identity/v3/projects/be830e76028c42f8a7d75f568aefac17/users/170db83939024196a4ffbff3806ffc55/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:11.265043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.277090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 947/1903] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:11.281469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.297337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df301174-ade6-43ba-a233-f54710e9088f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.367830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:11.404096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.404334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcda906-d96a-4ff7-a10a-d04485f3547e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.404718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.404998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.406134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.409487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.411274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.412954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.414396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.414755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.415798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.416500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.418449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.428905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 948/1904] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:11.429995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.434054 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 957/1905] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:11.434953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.442210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56135195-f7f0-43ba-b44d-798f068bd098 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.448419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1c2949-6a55-4e2f-82e8-ece96a87e4d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.449440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2949-6a55-4e2f-82e8-ece96a87e4d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.449822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2949-6a55-4e2f-82e8-ece96a87e4d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.450340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1c2949-6a55-4e2f-82e8-ece96a87e4d3 admin admin] PATH_INFO: `/v3/projects/27cafb3d0ae741989bf057abd9ab17f3/users/4a4d224367374b32a0d56860a50748ae/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.452093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd840baf-aaef-48c7-89ab-ae14d0b84ebc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.466424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.467220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.467574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.467957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] PATH_INFO: `/v3/projects/be830e76028c42f8a7d75f568aefac17/users/170db83939024196a4ffbff3806ffc55/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.470457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c2949-6a55-4e2f-82e8-ece96a87e4d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27cafb3d0ae741989bf057abd9ab17f3, user_id=4a4d224367374b32a0d56860a50748ae, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.471438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be830e76028c42f8a7d75f568aefac17, user_id=170db83939024196a4ffbff3806ffc55, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.473122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1c2949-6a55-4e2f-82e8-ece96a87e4d3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.474344 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.488777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 958/1906] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:11 2022] PUT /identity/v3/projects/be830e76028c42f8a7d75f568aefac17/users/170db83939024196a4ffbff3806ffc55/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:11.491427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 949/1907] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:11 2022] PUT /identity/v3/projects/27cafb3d0ae741989bf057abd9ab17f3/users/4a4d224367374b32a0d56860a50748ae/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:11.499852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.503934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68eb3-bc3d-4128-90d4-dc569238fdd5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.504502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68eb3-bc3d-4128-90d4-dc569238fdd5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.504776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d68eb3-bc3d-4128-90d4-dc569238fdd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.546157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-08d68eb3-bc3d-4128-90d4-dc569238fdd5 None None] MFA Rules not processed for user `170db83939024196a4ffbff3806ffc55`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:11.547589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-08d68eb3-bc3d-4128-90d4-dc569238fdd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:11.595818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bfd53d-6b9e-4f8f-ad39-61aeef7acd93 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.681315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 950/1908] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:11.684289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.684741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.685230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.698821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:11.713084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.713827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.714214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.714592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.715635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.723460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.734571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] MFA Rules not processed for user `4a4d224367374b32a0d56860a50748ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:11.736371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:11.750297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 959/1909] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:11.750297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.753073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:11.901762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84de49b8-248e-4d61-99a1-bd5d4b296ace admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.916308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.917435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.917814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.918426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.925411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 951/1910] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 243 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:11.926383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.953519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.954080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec73e399-b466-4209-bf33-f0308aae26a0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:11.956121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:11.969118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e3a949-ecfd-484d-9040-374cb7d6a46f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:11.969966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3a949-ecfd-484d-9040-374cb7d6a46f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:11.970260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3a949-ecfd-484d-9040-374cb7d6a46f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:11.970710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e3a949-ecfd-484d-9040-374cb7d6a46f admin admin] PATH_INFO: `/v3/projects/fa2be6bd0b56453a9915c40449bf1085/users/50a700026eb247d6b35b7fa2b26351ec/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:11.984276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 960/1911] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:11 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:11.987978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:11.990824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3a949-ecfd-484d-9040-374cb7d6a46f admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa2be6bd0b56453a9915c40449bf1085, user_id=50a700026eb247d6b35b7fa2b26351ec, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:11.996743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e3a949-ecfd-484d-9040-374cb7d6a46f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.008839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b42207-6cc9-47a5-99b3-0d0670f39089 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.016790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 952/1912] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:11 2022] PUT /identity/v3/projects/fa2be6bd0b56453a9915c40449bf1085/users/50a700026eb247d6b35b7fa2b26351ec/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:12.034575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753312-be45-459f-967e-7152ab2496bc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.034853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753312-be45-459f-967e-7152ab2496bc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.035126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37753312-be45-459f-967e-7152ab2496bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.060795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.073271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-37753312-be45-459f-967e-7152ab2496bc None None] MFA Rules not processed for user `50a700026eb247d6b35b7fa2b26351ec`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:12.078435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-37753312-be45-459f-967e-7152ab2496bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:12.090683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.091310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.091599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.091868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.092607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.094561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.126004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 961/1913] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:11 2022] POST /identity/v3/projects => generated 379 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:12.129931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.166704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 953/1914] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:12.179732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753312-be45-459f-967e-7152ab2496bc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.181941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-37753312-be45-459f-967e-7152ab2496bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:12.216784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d377ea-d0dd-4690-b48a-6674935c8198 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.223520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.224371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.224989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.224989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.226223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.228136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.251539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 962/1915] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:12 2022] POST /identity/v3/users => generated 296 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:12.256234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.260330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37753312-be45-459f-967e-7152ab2496bc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.271071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6d4fa-8929-4b8e-a145-080dd28a2e77 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.277570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.278306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.278744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.279023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.279742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.281703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.287519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.294087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 963/1916] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:12.298713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.314251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3002f75c-9f22-4c6c-a7ca-c7a63becd847 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.319201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.320569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.320865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.321154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] PATH_INFO: `/v3/projects/65892fe6cddb4c43b173e3ee72f3b4b0/users/1c1461de13664e4a917975c1cc57a2ae/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.332701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.333309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.333586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.333856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.338694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=65892fe6cddb4c43b173e3ee72f3b4b0, user_id=1c1461de13664e4a917975c1cc57a2ae, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.342677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.366294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 964/1917] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:12 2022] PUT /identity/v3/projects/65892fe6cddb4c43b173e3ee72f3b4b0/users/1c1461de13664e4a917975c1cc57a2ae/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:12.380258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.418560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.420197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.430100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 954/1918] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:12.436956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.449167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.453464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7475aa5-9f70-40cc-929b-5c24e13069fb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.458382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.459113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.459464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.459812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.460824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.462624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.473135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 965/1919] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:12.477790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.489125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6547b4ec-4563-4944-8296-c399dc002f9b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.497278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e1363-efd0-40a4-821d-34dbb7a2a425 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.497946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1363-efd0-40a4-821d-34dbb7a2a425 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.498230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1363-efd0-40a4-821d-34dbb7a2a425 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.498528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e1363-efd0-40a4-821d-34dbb7a2a425 admin admin] PATH_INFO: `/v3/projects/65892fe6cddb4c43b173e3ee72f3b4b0/users/1c1461de13664e4a917975c1cc57a2ae/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.501377 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e1363-efd0-40a4-821d-34dbb7a2a425 admin admin] RBAC: Authorizing `identity:create_grant(project_id=65892fe6cddb4c43b173e3ee72f3b4b0, user_id=1c1461de13664e4a917975c1cc57a2ae, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.504576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e1363-efd0-40a4-821d-34dbb7a2a425 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.512520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5930774-b3b2-4393-b046-5e87d83ea9b4 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.516919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 966/1920] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:12 2022] PUT /identity/v3/projects/65892fe6cddb4c43b173e3ee72f3b4b0/users/1c1461de13664e4a917975c1cc57a2ae/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:12.526822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.527110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.527378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.556786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] MFA Rules not processed for user `1c1461de13664e4a917975c1cc57a2ae`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:12.558040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:12.578880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '170db83939024196a4ffbff3806ffc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be830e76028c42f8a7d75f568aefac17', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.579658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.580034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.580431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.581276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:12.581865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.583633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.597118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 955/1921] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:12.604151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.615986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b775bdc-2a5f-4e0d-b8f7-44d2cfe15a92 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.621629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '170db83939024196a4ffbff3806ffc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be830e76028c42f8a7d75f568aefac17', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.622312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.622926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.622926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.623686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.625758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.652574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 967/1922] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:12 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:12.664703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 956/1923] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:12 2022] POST /identity/v3/projects => generated 353 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:12.669170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.683823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62fe5dc-2733-48a3-8f9b-559426b07fb3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.688088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.762351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.765853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92d632a-7eaf-47ca-a07a-f743ccaf3c60 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.776259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.777685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.778067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.781409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.801620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '170db83939024196a4ffbff3806ffc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be830e76028c42f8a7d75f568aefac17', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.801620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.801620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.801867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.801867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:12.801867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.801867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.815756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 968/1924] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:01:12.861117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:12.901063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.901313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:12.907440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:12.917810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b7b826d-2a1b-40f7-82f7-823a4aee6b23 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:12.924524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '170db83939024196a4ffbff3806ffc55', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'be830e76028c42f8a7d75f568aefac17', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:12.925411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:12.925926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:12.926343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] PATH_INFO: `/v3/projects/dff54996361642acb2bd232c481b61ae` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:12.927762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorizing `identity:delete_project(project_id=dff54996361642acb2bd232c481b61ae)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:12.930457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 957/1925] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:12 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:12.931681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.004505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.013239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dff54996361642acb2bd232c481b61ae', 'request_id': 'req-acccc050-5a14-4a90-a758-10e1cd918794'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.019570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e96ff82-423a-4524-8595-72ccf27aa645 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.019907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dff54996361642acb2bd232c481b61ae', 'request_id': 'req-acccc050-5a14-4a90-a758-10e1cd918794'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.035490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dff54996361642acb2bd232c481b61ae', 'request_id': 'req-acccc050-5a14-4a90-a758-10e1cd918794'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.058039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] The token cache is being invalidate because project dff54996361642acb2bd232c481b61ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:13.058488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.061163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.065168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 969/1926] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:12 2022] DELETE /identity/v3/projects/dff54996361642acb2bd232c481b61ae => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:13.093898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.094825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.095405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.095829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.099061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:13.209789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.212430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.242335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 958/1927] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:13 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:13.571693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.573365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:13.586672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.588425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:13.667131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acccc050-5a14-4a90-a758-10e1cd918794 tempest-VolumeQuotaClassesTest-1141586823 tempest-VolumeQuotaClassesTest-1141586823-project-admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.670328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116c5ff0-85eb-4400-a93a-16ae15880478 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:13.676512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.677499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.677618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:13.677743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.678067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] PATH_INFO: `/v3/users/b31c16d1c4004b8f837c8d325f9c83a6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.678620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.678789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.679309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] PATH_INFO: `/v3/users/daa5bf4a700741bba540cc590cba32c2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.679824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b31c16d1c4004b8f837c8d325f9c83a6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.681922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] RBAC: Authorizing `identity:delete_user(user_id=daa5bf4a700741bba540cc590cba32c2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:13.682049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.684965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:13.758131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:13.762965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b31c16d1c4004b8f837c8d325f9c83a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.767683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b31c16d1c4004b8f837c8d325f9c83a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.770792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'daa5bf4a700741bba540cc590cba32c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.772002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'daa5bf4a700741bba540cc590cba32c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.779243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b31c16d1c4004b8f837c8d325f9c83a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.790960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b31c16d1c4004b8f837c8d325f9c83a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.792625 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:13.794562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'daa5bf4a700741bba540cc590cba32c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.807318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'daa5bf4a700741bba540cc590cba32c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.816970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-38853e95-b660-4ef5-be5f-bc410f68185a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'daa5bf4a700741bba540cc590cba32c2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.822580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-0206706c-fe11-42af-a434-7bdb16a64a60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b31c16d1c4004b8f837c8d325f9c83a6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:13.828030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 959/1928] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:13 2022] DELETE /identity/v3/users/daa5bf4a700741bba540cc590cba32c2 => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:13.831269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 970/1929] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:13 2022] DELETE /identity/v3/users/b31c16d1c4004b8f837c8d325f9c83a6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:13.837537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.837828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.838110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.840281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:13.840566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:13.840843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:13.878897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:13.879883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:13.881173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:13.881282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:13.958431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 960/1930] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:13.980424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.982976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 971/1931] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:13.984252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:13.994058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:13.995990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.074139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8def11f-a639-4f19-a76f-6e1ceb657b03 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:14.078930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:14.079779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.080154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.080445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.092484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:14.094067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:14.105617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 972/1932] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:14.106538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:14.108443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.122520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b01eeb3-8317-46b5-a36b-a1bc6a7e21b2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:14.122734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b62052e-2431-4fa4-96bc-cbad40a5df78 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:14.128516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:14.129247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081187ec-6f67-4916-a41d-21ccb4a8cd82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:14.129443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.129886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081187ec-6f67-4916-a41d-21ccb4a8cd82 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.129993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.130199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081187ec-6f67-4916-a41d-21ccb4a8cd82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.130311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] PATH_INFO: `/v3/users/44452c76ce394aaabde1414316ae7542` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.130478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081187ec-6f67-4916-a41d-21ccb4a8cd82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.131402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=44452c76ce394aaabde1414316ae7542)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:14.134164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:14.145783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081187ec-6f67-4916-a41d-21ccb4a8cd82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:14.147521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-081187ec-6f67-4916-a41d-21ccb4a8cd82 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:14.166707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 961/1933] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:14.230037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44452c76ce394aaabde1414316ae7542'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:14.231210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44452c76ce394aaabde1414316ae7542'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:14.245348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44452c76ce394aaabde1414316ae7542'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:14.260964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44452c76ce394aaabde1414316ae7542'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:14.313074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:14.315172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44452c76ce394aaabde1414316ae7542'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:14.333248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 973/1934] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:14 2022] DELETE /identity/v3/users/44452c76ce394aaabde1414316ae7542 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:14.334235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.334556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.335027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.385832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:14.389930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.482718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:14.511821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 962/1935] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:14.534925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:14.536680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.668374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e82310a-035b-46c7-97be-2191364d7d6c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:14.673067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:14.673876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.674361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.674811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.686888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:14.689093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:14.704079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 974/1936] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:14.827882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:14.831667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.851385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f55cf6-c578-4ca1-8321-4065cc101302 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:14.876396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:14.880678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:14.881019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:14.881309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] PATH_INFO: `/v3/projects/706a71aa5d774e24a5d46907e808bbd8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:14.883374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] RBAC: Authorizing `identity:delete_project(project_id=706a71aa5d774e24a5d46907e808bbd8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:14.885477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:14.946334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:14.951703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:14.988941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12fa7d41-e933-43b4-9c28-e8b739ec5e9e service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.000628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '706a71aa5d774e24a5d46907e808bbd8', 'request_id': 'req-3e195d87-c18a-4c4d-afc4-867e59b40e1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.016324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '706a71aa5d774e24a5d46907e808bbd8', 'request_id': 'req-3e195d87-c18a-4c4d-afc4-867e59b40e1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.036117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '706a71aa5d774e24a5d46907e808bbd8', 'request_id': 'req-3e195d87-c18a-4c4d-afc4-867e59b40e1f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.062781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] The token cache is being invalidate because project 706a71aa5d774e24a5d46907e808bbd8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:15.063341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.064159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.067646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 963/1937] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:14 2022] DELETE /identity/v3/projects/706a71aa5d774e24a5d46907e808bbd8 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:15.071387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.073129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:15.092585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.093329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.094909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.095258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] PATH_INFO: `/v3/projects/a42ae6ec871849e6940c9790ec3830c1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.101639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=a42ae6ec871849e6940c9790ec3830c1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.103827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.175949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e195d87-c18a-4c4d-afc4-867e59b40e1f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.200159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a42ae6ec871849e6940c9790ec3830c1', 'request_id': 'req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.221500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a42ae6ec871849e6940c9790ec3830c1', 'request_id': 'req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.233143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a42ae6ec871849e6940c9790ec3830c1', 'request_id': 'req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.254309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] The token cache is being invalidate because project a42ae6ec871849e6940c9790ec3830c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:15.254679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.255519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.260597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 975/1938] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:14 2022] DELETE /identity/v3/projects/a42ae6ec871849e6940c9790ec3830c1 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:15.261375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.263154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:15.276201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.277138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.277408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.277682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] PATH_INFO: `/v3/users/170db83939024196a4ffbff3806ffc55` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.279071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=170db83939024196a4ffbff3806ffc55)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.281423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.302227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.326097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.350762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb0d992-b28e-4822-98f0-3cc0c8aa3a2d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.354017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '170db83939024196a4ffbff3806ffc55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.354865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '170db83939024196a4ffbff3806ffc55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.360393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.361448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.361926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.362567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] PATH_INFO: `/v3/projects/96612f5a9841489aab25ff07556b2dcd` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.364321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96612f5a9841489aab25ff07556b2dcd)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.367266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.371333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '170db83939024196a4ffbff3806ffc55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.386444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '170db83939024196a4ffbff3806ffc55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.394128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '170db83939024196a4ffbff3806ffc55'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.402554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 964/1939] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:15 2022] DELETE /identity/v3/users/170db83939024196a4ffbff3806ffc55 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:15.404135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.406673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:15.471706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96612f5a9841489aab25ff07556b2dcd', 'request_id': 'req-6fbc87d5-b283-4c44-b393-7462818ec6b7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.484382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96612f5a9841489aab25ff07556b2dcd', 'request_id': 'req-6fbc87d5-b283-4c44-b393-7462818ec6b7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.502965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96612f5a9841489aab25ff07556b2dcd', 'request_id': 'req-6fbc87d5-b283-4c44-b393-7462818ec6b7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.520668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] The token cache is being invalidate because project 96612f5a9841489aab25ff07556b2dcd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:15.521305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.536205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.537954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 976/1940] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:15 2022] DELETE /identity/v3/projects/96612f5a9841489aab25ff07556b2dcd => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:15.542359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.543861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:15.553146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a30a02-7b69-4b0e-b82b-f1629a33dfe2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.665910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.666624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.666902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.667175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] PATH_INFO: `/v3/users/71564b25827f4e4582011c61eb32fcac` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.668558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] RBAC: Authorizing `identity:delete_user(user_id=71564b25827f4e4582011c61eb32fcac)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.670745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.672893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbc87d5-b283-4c44-b393-7462818ec6b7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:15.681342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:15.682408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:15.682898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:15.683375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] PATH_INFO: `/v3/users/2f6f31271b42486d880a4302cd8d7496` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:15.685524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f6f31271b42486d880a4302cd8d7496)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:15.689140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:15.766498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f6f31271b42486d880a4302cd8d7496'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.767302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f6f31271b42486d880a4302cd8d7496'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.780897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f6f31271b42486d880a4302cd8d7496'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.782451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71564b25827f4e4582011c61eb32fcac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.784585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71564b25827f4e4582011c61eb32fcac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.791442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.797369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:15.813851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71564b25827f4e4582011c61eb32fcac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.815240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f6f31271b42486d880a4302cd8d7496'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.830185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71564b25827f4e4582011c61eb32fcac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.844280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f6f31271b42486d880a4302cd8d7496'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.845058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71564b25827f4e4582011c61eb32fcac'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:15.854195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 965/1941] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:15 2022] DELETE /identity/v3/users/71564b25827f4e4582011c61eb32fcac => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:15.856922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 977/1942] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:15 2022] DELETE /identity/v3/users/2f6f31271b42486d880a4302cd8d7496 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:15.977904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:15.980129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.043137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.045615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.148456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0728d215-b165-4d65-9ff3-852c5a77831d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.156167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.156812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.157092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.157542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] PATH_INFO: `/v3/users/50a700026eb247d6b35b7fa2b26351ec` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.165308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a700026eb247d6b35b7fa2b26351ec)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.167447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:16.184930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45826033-b5ba-463a-b71a-1975e8b64993 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.205764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.206946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.207338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.207688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] PATH_INFO: `/v3/projects/be830e76028c42f8a7d75f568aefac17` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.209880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=be830e76028c42f8a7d75f568aefac17)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.222620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:16.244253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a700026eb247d6b35b7fa2b26351ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.244986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a700026eb247d6b35b7fa2b26351ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.260504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a700026eb247d6b35b7fa2b26351ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.279922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a700026eb247d6b35b7fa2b26351ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.293931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-babd4994-56bb-4db3-b9af-5a941fcfc738 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a700026eb247d6b35b7fa2b26351ec'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.302553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 966/1943] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:15 2022] DELETE /identity/v3/users/50a700026eb247d6b35b7fa2b26351ec => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:16.303675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6f00-5a8c-4d75-99b8-bc8ad2aec265 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.304087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6f00-5a8c-4d75-99b8-bc8ad2aec265 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.304382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6f00-5a8c-4d75-99b8-bc8ad2aec265 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.306348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 967/1944] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:01:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:16.307979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f41d-50bb-4b5f-9870-f147e18eb5ad None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.308361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f41d-50bb-4b5f-9870-f147e18eb5ad None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.308638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb71f41d-50bb-4b5f-9870-f147e18eb5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.338667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be830e76028c42f8a7d75f568aefac17', 'request_id': 'req-c37974bf-31d1-44a4-a1c4-e92c423dac4a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.344336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-eb71f41d-50bb-4b5f-9870-f147e18eb5ad None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:16.345657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-eb71f41d-50bb-4b5f-9870-f147e18eb5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.352327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be830e76028c42f8a7d75f568aefac17', 'request_id': 'req-c37974bf-31d1-44a4-a1c4-e92c423dac4a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.371441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be830e76028c42f8a7d75f568aefac17', 'request_id': 'req-c37974bf-31d1-44a4-a1c4-e92c423dac4a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.391569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] The token cache is being invalidate because project be830e76028c42f8a7d75f568aefac17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:16.392080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.393334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c37974bf-31d1-44a4-a1c4-e92c423dac4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.401707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 978/1945] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:16 2022] DELETE /identity/v3/projects/be830e76028c42f8a7d75f568aefac17 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:16.405027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.410188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.410492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.450369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:16.462538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:16.465416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.486688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 968/1946] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:16.487984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.488711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.489285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.528088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:16.529484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.539539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 969/1947] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:16.540573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.546569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.568489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:16.581958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 979/1948] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:16.585824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.586425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.614396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e515d791-dbbb-43d5-862e-14716c4f953c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.631056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.635773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.636511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.637007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] PATH_INFO: `/v3/projects/eea603fae86843e6ae87e247a8f554b5` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.643053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec25191e-a348-4c2b-b4b2-ddf278fab2a9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.647318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ff4205-bdd3-4728-b166-d877c2d7c5c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.648091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4205-bdd3-4728-b166-d877c2d7c5c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.648910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4205-bdd3-4728-b166-d877c2d7c5c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.649132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=eea603fae86843e6ae87e247a8f554b5)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.649264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ff4205-bdd3-4728-b166-d877c2d7c5c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.652189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:16.660998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4205-bdd3-4728-b166-d877c2d7c5c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.663181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ff4205-bdd3-4728-b166-d877c2d7c5c7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:16.679438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 970/1949] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:16.681291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.681768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.682058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.712071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:16.714291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.722849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eea603fae86843e6ae87e247a8f554b5', 'request_id': 'req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.730305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eea603fae86843e6ae87e247a8f554b5', 'request_id': 'req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.742069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eea603fae86843e6ae87e247a8f554b5', 'request_id': 'req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.757920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] The token cache is being invalidate because project eea603fae86843e6ae87e247a8f554b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:16.758250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.758932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.760970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 980/1950] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:16 2022] DELETE /identity/v3/projects/eea603fae86843e6ae87e247a8f554b5 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:16.764426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.764426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.818355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 971/1951] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:16.819330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:16.821202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.877232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc1007a-55a9-4e9c-b304-3d06fb3c6c4c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.886518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.887534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.888220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.888220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] PATH_INFO: `/v3/projects/cdcee8dd9bf94b7f85cb765be405dac3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.889946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] RBAC: Authorizing `identity:delete_project(project_id=cdcee8dd9bf94b7f85cb765be405dac3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.892497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:16.945391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ad98a-b045-4da6-814c-6977b1f81479 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:16.965348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:16.966835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:16.967327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:16.967755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:16.970402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:16.973630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cdcee8dd9bf94b7f85cb765be405dac3', 'request_id': 'req-61515d2d-bfb5-4f3c-9014-99ce3a19703a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.980954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cdcee8dd9bf94b7f85cb765be405dac3', 'request_id': 'req-61515d2d-bfb5-4f3c-9014-99ce3a19703a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.991309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cdcee8dd9bf94b7f85cb765be405dac3', 'request_id': 'req-61515d2d-bfb5-4f3c-9014-99ce3a19703a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:16.993168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:16.995256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418621e9-4ab0-415c-a8ae-9688694c9510 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.006440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] The token cache is being invalidate because project cdcee8dd9bf94b7f85cb765be405dac3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:17.006720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.008709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.011402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 981/1952] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:16 2022] DELETE /identity/v3/projects/cdcee8dd9bf94b7f85cb765be405dac3 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:17.012636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.014961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.021942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 972/1953] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:17.026219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.029491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.029491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.035746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:17.080275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.083080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.103407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:17.126270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61515d2d-bfb5-4f3c-9014-99ce3a19703a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.133001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.133493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.133974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.134279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] PATH_INFO: `/v3/users/fad869067cb54c25b4a5713a122e6c4f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.135636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fad869067cb54c25b4a5713a122e6c4f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.138469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.199049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 973/1954] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.199926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.206819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.212390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fad869067cb54c25b4a5713a122e6c4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.213123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fad869067cb54c25b4a5713a122e6c4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.226578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d2c228-3b0b-4fc2-9ba4-db935179cd81 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.228463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fad869067cb54c25b4a5713a122e6c4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.234659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.236264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.237930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.238289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.239006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:17.241174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.242111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fad869067cb54c25b4a5713a122e6c4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.244706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d521c90-9b4d-4622-9cc4-91ec2100baef admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.260829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 974/1955] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:17.262203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c408-881a-48e4-8472-6f6cf5a98729 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.262436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c408-881a-48e4-8472-6f6cf5a98729 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.263284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3607c408-881a-48e4-8472-6f6cf5a98729 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.266104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fad869067cb54c25b4a5713a122e6c4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.280109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 982/1956] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:17 2022] DELETE /identity/v3/users/fad869067cb54c25b4a5713a122e6c4f => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:17.281136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.282838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.291874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3607c408-881a-48e4-8472-6f6cf5a98729 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.293214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3607c408-881a-48e4-8472-6f6cf5a98729 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.380549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8216b31c-9c0b-48db-8c63-d5c065e11f7e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.388355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.389242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.389551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.389899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] PATH_INFO: `/v3/projects/fa2be6bd0b56453a9915c40449bf1085` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.394918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 975/1957] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.396154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa2be6bd0b56453a9915c40449bf1085)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.398518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.399081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.399543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.401774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.431179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.433944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.443685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 976/1958] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.444548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.448071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.453197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:17.461093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd434e3-36d7-49bd-ada6-5a0e81d2afc0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.467490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa2be6bd0b56453a9915c40449bf1085', 'request_id': 'req-dfaeee19-8bcd-4acc-b9e1-a41f35136732'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.473545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa2be6bd0b56453a9915c40449bf1085', 'request_id': 'req-dfaeee19-8bcd-4acc-b9e1-a41f35136732'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.497218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa2be6bd0b56453a9915c40449bf1085', 'request_id': 'req-dfaeee19-8bcd-4acc-b9e1-a41f35136732'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.526056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] The token cache is being invalidate because project fa2be6bd0b56453a9915c40449bf1085 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:17.526527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.527202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-dfaeee19-8bcd-4acc-b9e1-a41f35136732 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:17.529078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 983/1959] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:17 2022] DELETE /identity/v3/projects/fa2be6bd0b56453a9915c40449bf1085 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:17.530853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d07bf0-2709-4eec-a49c-44359e5aa8dc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.531143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d07bf0-2709-4eec-a49c-44359e5aa8dc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.531418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d07bf0-2709-4eec-a49c-44359e5aa8dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.545858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.546679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.546965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.547323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.548003 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.551171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.554357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-60d07bf0-2709-4eec-a49c-44359e5aa8dc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.555566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-60d07bf0-2709-4eec-a49c-44359e5aa8dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.566630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 984/1960] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.566630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f7f02-0410-4e38-afda-96c0109066e5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.566630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f7f02-0410-4e38-afda-96c0109066e5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.566630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59f7f02-0410-4e38-afda-96c0109066e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.586256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 977/1961] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:17.586256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.586545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b59f7f02-0410-4e38-afda-96c0109066e5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.587641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.587764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b59f7f02-0410-4e38-afda-96c0109066e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.615101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:17.655595 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 985/1962] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.657026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.657389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.657736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.673159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ea8495-c3df-4e77-b23a-bbbcb6649d3e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.677433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.678187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.678858 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.679022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.679131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.679500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.680187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:17.680501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.682245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.694383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 986/1963] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.694383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.694383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.703310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 978/1964] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:17.704194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.708073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.714084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb698447-cef8-4ad1-93da-f5dab7dabde2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.720655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.721472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.721703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.721971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.722655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.724685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.748109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 987/1965] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/users => generated 287 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:17.748109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.769189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd764fd-3119-405c-a5c5-fc0cc60cf2dd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.774386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.774985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.775258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.775528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.776295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:17.776616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.778335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4549b2-9b99-4196-afb2-6bfc2db82a6f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.786337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b399a5-cbad-462f-a5a6-dd1e334406c6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.790259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.790414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 988/1966] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:17.790951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.791345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.791481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.791750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.791854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.792023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.802229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.803647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.811469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:17.812816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:17.813695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 979/1967] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:17.814561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.825051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 989/1968] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:17.825051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.828124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589b5f20-b810-4b57-a8dc-c265914cea2d service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.833667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.834359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.834642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.834755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c111089-4ab2-45e7-aae9-1940ca4ebeb7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.835655 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.836368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.838277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.840418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.840866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.841147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.841416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.842346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.843632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.857591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 990/1969] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:17.857591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.866135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933eed72-5778-4cc0-9a97-e59f8b618fa9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.871392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:17.872327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:17.872834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:17.873314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:17.874351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:17.878671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 980/1970] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:17.878671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.880870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:17.915955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 991/1971] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] POST /identity/v3/projects => generated 365 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:17.915955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:17.965043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5fcc18-9a77-4318-8ab0-39c602b0d743 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:17.978209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.002704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb739276-15a2-42f7-a419-e3fb5f63bf05 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.009728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.010352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.010783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.011186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.012434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.012994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.015272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.030209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 992/1972] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:18.030209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.033861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.034579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.034860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.035199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.035984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:18.036377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.038224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.039083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6732895-b56c-4f5e-bd19-8e6f320db882 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.044089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.044632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.044914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.045188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.045817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.047741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.054307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 981/1973] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:18.054307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.065277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55b069e8-c2b3-4dc3-9463-363b71f203c4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.071553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.072196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.072484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.072652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 993/1974] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/users => generated 289 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:18.072748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.073380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.075319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.076373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.087879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d62922-ce61-4162-bc40-8970a9878f90 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.093646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.094466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.094594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.095449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] PATH_INFO: `/v3/projects/3e844eaf2c784c859864c749273c01c6/users/88fa94e9cdaa473ba72d3af58cb05925/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.105644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 982/1975] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/users => generated 283 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:18.105644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.115458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e83f1f1-a7b4-4cf4-bdc9-91920e8731fc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.120903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e844eaf2c784c859864c749273c01c6, user_id=88fa94e9cdaa473ba72d3af58cb05925, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.124945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.125155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.125773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.126049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.126321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.126948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.129682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.142657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 994/1976] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:18 2022] PUT /identity/v3/projects/3e844eaf2c784c859864c749273c01c6/users/88fa94e9cdaa473ba72d3af58cb05925/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:18.143751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.164740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 983/1977] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/projects => generated 377 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:18.165404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.214754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2359333-c950-4ff5-b23b-c4ac7ea525e6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.229236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aa33a4-f5b2-48af-804d-2bb8db3ff331 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.234555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.235187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.235464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.235733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.236414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.237984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.248422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 984/1978] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:18.249323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.251031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.264231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a184bdd-6022-481a-aed1-8d446409a430 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.268887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.269491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.269768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.270029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] PATH_INFO: `/v3/projects/1933c077bb20456b80f42cf51f6fb4d4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.271146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=1933c077bb20456b80f42cf51f6fb4d4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.272324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad83280-ad5f-4c17-ac89-b9eef0a56997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.272938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83280-ad5f-4c17-ac89-b9eef0a56997 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.273218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83280-ad5f-4c17-ac89-b9eef0a56997 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.273314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.273490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad83280-ad5f-4c17-ac89-b9eef0a56997 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.274143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad83280-ad5f-4c17-ac89-b9eef0a56997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.275725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad83280-ad5f-4c17-ac89-b9eef0a56997 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.285898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 995/1979] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:18.287094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.287379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.287654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.307041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:18.308275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.322345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1933c077bb20456b80f42cf51f6fb4d4', 'request_id': 'req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.328248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1933c077bb20456b80f42cf51f6fb4d4', 'request_id': 'req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.336064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1933c077bb20456b80f42cf51f6fb4d4', 'request_id': 'req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.341232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.349475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] The token cache is being invalidate because project 1933c077bb20456b80f42cf51f6fb4d4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:18.349762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.350401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.351993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 985/1980] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:18 2022] DELETE /identity/v3/projects/1933c077bb20456b80f42cf51f6fb4d4 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:18.352837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.354128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.371852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.373895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 996/1981] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:18.375408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.377848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.397787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667acf64-cb65-4e06-9488-97a024e317d3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.405728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.406840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.407124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.407396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.408150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.410308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.429645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 997/1982] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:18.430947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.433085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.433357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df9ecaf-ddd9-4c71-876c-3ffce790e8de admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.438221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.438834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.439109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.439377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.439986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.441913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.449019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9001996f-9d9e-42bb-82ca-eb814b50c603 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.457569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.458234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.458585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.458932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.459664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.461485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.475056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 986/1983] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/users => generated 289 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:18.475056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.477564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.484085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 998/1984] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:18.488929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.494001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a821204d-b59e-465e-b39c-dad2fa3886b6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.496940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.506366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.507206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.507572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.507945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] PATH_INFO: `/v3/users/4a4d224367374b32a0d56860a50748ae` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.509681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a4d224367374b32a0d56860a50748ae)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.511941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.579097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421e467-225d-4e93-9bfa-c534e9c9b374 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.580273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a4d224367374b32a0d56860a50748ae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.581321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a4d224367374b32a0d56860a50748ae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.583991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.584635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.584944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.585230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.598517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.599361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a4d224367374b32a0d56860a50748ae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.599964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.609080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a4d224367374b32a0d56860a50748ae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.611514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 999/1985] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:18.612359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.624683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85015c07-3722-4f62-af48-73aaac68fa78 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.629734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a4d224367374b32a0d56860a50748ae'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:18.642384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.643177 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 987/1986] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:18 2022] DELETE /identity/v3/users/4a4d224367374b32a0d56860a50748ae => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:18.643292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.643468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.643823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] PATH_INFO: `/v3/projects/b23d9db17da44599af6a23361d57e643/users/c384e758c4e64944a33f04ea5e2a3226/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.644091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.645455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.673283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23d9db17da44599af6a23361d57e643, user_id=c384e758c4e64944a33f04ea5e2a3226, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.676118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.701316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1000/1987] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:18 2022] PUT /identity/v3/projects/b23d9db17da44599af6a23361d57e643/users/c384e758c4e64944a33f04ea5e2a3226/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:18.702455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:18.704485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.748938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2ad0d6-ed07-4e6b-b22c-47e18bd31cda admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.788628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c07610-5ed8-4ff7-9cb2-7474e1ba2fcf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:18.794651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ce0192-5b99-442a-bc24-777f1ddd5611 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.795644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce0192-5b99-442a-bc24-777f1ddd5611 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.796086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce0192-5b99-442a-bc24-777f1ddd5611 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.796458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ce0192-5b99-442a-bc24-777f1ddd5611 admin admin] PATH_INFO: `/v3/projects/d84fcf3ef9ca4a259e5adaa8596ff0ed/users/fe4a2e9bbe5544c3bf268e2bbdb07886/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.809434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.814865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce0192-5b99-442a-bc24-777f1ddd5611 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d84fcf3ef9ca4a259e5adaa8596ff0ed, user_id=fe4a2e9bbe5544c3bf268e2bbdb07886, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.817872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ce0192-5b99-442a-bc24-777f1ddd5611 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.840118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1001/1988] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:18 2022] PUT /identity/v3/projects/d84fcf3ef9ca4a259e5adaa8596ff0ed/users/fe4a2e9bbe5544c3bf268e2bbdb07886/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:18.840118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.840118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.840118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.876920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] MFA Rules not processed for user `c384e758c4e64944a33f04ea5e2a3226`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:18.878250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:18.885355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:18.889206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac80cfa-cc7e-48ca-a89b-99bb8b42e9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:18.890061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac80cfa-cc7e-48ca-a89b-99bb8b42e9fa admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.890347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac80cfa-cc7e-48ca-a89b-99bb8b42e9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.890626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac80cfa-cc7e-48ca-a89b-99bb8b42e9fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.891677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac80cfa-cc7e-48ca-a89b-99bb8b42e9fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:18.894382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac80cfa-cc7e-48ca-a89b-99bb8b42e9fa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:18.909792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 988/1989] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:18 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:18.916455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:18.916771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:18.917049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:18.968907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] MFA Rules not processed for user `fe4a2e9bbe5544c3bf268e2bbdb07886`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:18.970130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.006434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1002/1990] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:19.006434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.153822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 989/1991] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:18 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:19.155356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.164167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.169170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6015c7e1-7ded-4b4c-9b4b-0314ab7abd04 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.175482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.176379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.176862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.177360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.178315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.182258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.184265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5266ece-b118-4d38-a6d0-69e6aa042a3a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.194134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1003/1992] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:19.196150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.198887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.200224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.201034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.201417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.201792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.202576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.204669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.226966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32f83e0-cf36-4a54-ab10-bd19d4dff35f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.233766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.234992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.234992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.235191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] PATH_INFO: `/v3/projects/27cafb3d0ae741989bf057abd9ab17f3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.237384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] RBAC: Authorizing `identity:delete_project(project_id=27cafb3d0ae741989bf057abd9ab17f3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.239505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.264916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 990/1993] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/projects => generated 363 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:19.264916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.345901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27cafb3d0ae741989bf057abd9ab17f3', 'request_id': 'req-77b15277-c92d-47b4-9c3b-2740dd19bd96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.353678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27cafb3d0ae741989bf057abd9ab17f3', 'request_id': 'req-77b15277-c92d-47b4-9c3b-2740dd19bd96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.369477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27cafb3d0ae741989bf057abd9ab17f3', 'request_id': 'req-77b15277-c92d-47b4-9c3b-2740dd19bd96'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.386158 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] The token cache is being invalidate because project 27cafb3d0ae741989bf057abd9ab17f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:19.386699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.388074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.392440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1004/1994] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:19 2022] DELETE /identity/v3/projects/27cafb3d0ae741989bf057abd9ab17f3 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:19.397947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.398814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f3c850-a3a1-4c7a-a548-cab152429f55 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.401069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.439118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:19.443366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:19.483730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.483933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.484142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.484456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.485063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.487562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.534604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b15277-c92d-47b4-9c3b-2740dd19bd96 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.542497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.543423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.543681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.544110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] PATH_INFO: `/v3/projects/83af72e84b4346a7b67b5dc2a4f17fc4/users/140a5d7204414d99a8d0114e265ece13/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.555383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 991/1995] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/projects => generated 379 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:19.555936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.561171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.563869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=83af72e84b4346a7b67b5dc2a4f17fc4, user_id=140a5d7204414d99a8d0114e265ece13, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.566642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.591747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1005/1996] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:19 2022] PUT /identity/v3/projects/83af72e84b4346a7b67b5dc2a4f17fc4/users/140a5d7204414d99a8d0114e265ece13/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:19.592647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.602492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.666822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fbc6a6-ee61-4dfa-8d31-1e020901f3b2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.711517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870f7761-e303-434f-972f-087b16f030aa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.734503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.735302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.735682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.736168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.737028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.738604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.739273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.739387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.739556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.739834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] PATH_INFO: `/v3/users/1c1461de13664e4a917975c1cc57a2ae` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.746795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1461de13664e4a917975c1cc57a2ae)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.750905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.769050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 992/1997] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/users => generated 288 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:19.770199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.773223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.787088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03192341-c124-4e7f-befd-faf67bb602e3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:19.792262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d8995f-825a-46e0-8a51-9d8df5e150ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:19.793029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8995f-825a-46e0-8a51-9d8df5e150ba admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.793386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8995f-825a-46e0-8a51-9d8df5e150ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.793728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d8995f-825a-46e0-8a51-9d8df5e150ba admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.794489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8995f-825a-46e0-8a51-9d8df5e150ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:19.796529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d8995f-825a-46e0-8a51-9d8df5e150ba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:19.823309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 993/1998] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/users => generated 296 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:19.825333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94975373-cf63-4720-931b-657c2a62f2ed None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.825333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94975373-cf63-4720-931b-657c2a62f2ed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.825907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94975373-cf63-4720-931b-657c2a62f2ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.859039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-94975373-cf63-4720-931b-657c2a62f2ed None None] MFA Rules not processed for user `140a5d7204414d99a8d0114e265ece13`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:19.860388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-94975373-cf63-4720-931b-657c2a62f2ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:19.914944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:19.916966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1461de13664e4a917975c1cc57a2ae'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.917674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1461de13664e4a917975c1cc57a2ae'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.933068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1461de13664e4a917975c1cc57a2ae'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.957690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1461de13664e4a917975c1cc57a2ae'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.974467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1461de13664e4a917975c1cc57a2ae'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:19.987767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 994/1999] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:19.987767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:19.987767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:19.987767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:19.989423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1006/2000] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:19 2022] DELETE /identity/v3/users/1c1461de13664e4a917975c1cc57a2ae => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:19.990529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:19.995500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.050645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.057382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] MFA Rules not processed for user `88fa94e9cdaa473ba72d3af58cb05925`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:20.059073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.107766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a7a30d-572c-4141-92bd-0cab6f3d539e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.121579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.122478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.122765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.123185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.124068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.126702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.141666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1007/2001] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:19 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:20.141666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.144919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.161275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48947da6-e294-456d-9aba-a151e52c063c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.166698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.167389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.167738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.168287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.169035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.171514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.172598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 995/2002] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:20.176901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.178581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.188684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1008/2003] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:20.188684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.192849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32594982-b6a9-4da3-b038-4d5a3403943f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.200313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.200880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.201234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.201443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.202776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.204475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.228759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff50e78-21cd-4a09-91a7-292c850dc11d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.236228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.238693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.239159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.239772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] PATH_INFO: `/v3/projects/924da98315734ec4a925fb26364397e3/users/490c592e64114e4b87e7ff2737ac166e/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.244560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 996/2004] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/projects => generated 375 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:20.246511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.249052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.265387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] RBAC: Authorizing `identity:create_grant(project_id=924da98315734ec4a925fb26364397e3, user_id=490c592e64114e4b87e7ff2737ac166e, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.268401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.286972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1009/2005] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:20 2022] PUT /identity/v3/projects/924da98315734ec4a925fb26364397e3/users/490c592e64114e4b87e7ff2737ac166e/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:20.288194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.338874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f79521e-ad75-496c-8a22-31465e6da908 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.380633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f2769f-1d6b-4b71-9103-316b09921f9a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.388335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.389029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.396325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.396325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] PATH_INFO: `/v3/projects/1044bd8ab432422696720941c52bb33c/users/a0bb7478ca5746e98e02d76342a0dae0/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.424108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.425059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1044bd8ab432422696720941c52bb33c, user_id=a0bb7478ca5746e98e02d76342a0dae0, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.428145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.443709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1010/2006] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:20 2022] PUT /identity/v3/projects/1044bd8ab432422696720941c52bb33c/users/a0bb7478ca5746e98e02d76342a0dae0/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:20.445135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.451065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.451703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.452032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.452297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.453521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.455663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.490319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 997/2007] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/projects => generated 371 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:20.492713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.517169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf3a995-68b2-4661-b05e-b31d6a5210d3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.539836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.580454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7a5ed5-99aa-4aba-8298-434d1e4a254c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.586172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.586505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.586716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.587001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.587110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.587318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.587406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.587652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.588006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.588319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.589712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.590287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.600578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 998/2008] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:20.604563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.612346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1011/2009] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/users => generated 288 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:20.613315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.614158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b797cb-f9cd-48e4-b64f-b323dd863b1c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.619457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.620064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.620475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.620751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.621387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.622998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.623607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df9166e-dc89-4b76-9994-3102e652e3a9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.630322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.630983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.631269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.631543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.633047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.635227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.636594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 999/2010] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:20.637405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.639067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.652805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abb1654-ebc0-4572-866f-f7d90abe6144 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.657912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.658538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.658820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.659095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] PATH_INFO: `/v3/projects/65892fe6cddb4c43b173e3ee72f3b4b0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.659257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1012/2011] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/users => generated 292 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:20.660063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.660294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=65892fe6cddb4c43b173e3ee72f3b4b0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.662327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.670228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b61c35-87e1-4b50-b495-27d0f672d1b4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.674873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.675577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.675838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.676142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] PATH_INFO: `/v3/projects/924da98315734ec4a925fb26364397e3/users/490c592e64114e4b87e7ff2737ac166e/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.678034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=924da98315734ec4a925fb26364397e3, user_id=490c592e64114e4b87e7ff2737ac166e, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.681206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.693192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1013/2012] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:20 2022] PUT /identity/v3/projects/924da98315734ec4a925fb26364397e3/users/490c592e64114e4b87e7ff2737ac166e/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:20.701181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.713494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '65892fe6cddb4c43b173e3ee72f3b4b0', 'request_id': 'req-39a1bae8-1772-4b23-9374-dddd42fe2fc9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:20.719100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '65892fe6cddb4c43b173e3ee72f3b4b0', 'request_id': 'req-39a1bae8-1772-4b23-9374-dddd42fe2fc9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:20.725366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '65892fe6cddb4c43b173e3ee72f3b4b0', 'request_id': 'req-39a1bae8-1772-4b23-9374-dddd42fe2fc9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:20.738535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] The token cache is being invalidate because project 65892fe6cddb4c43b173e3ee72f3b4b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:20.738827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:20.739473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:20.741012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1000/2013] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:20 2022] DELETE /identity/v3/projects/65892fe6cddb4c43b173e3ee72f3b4b0 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:20.747740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.749150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.766120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ad8242-27b6-442d-9c1a-71563ecf3ec4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.792202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.817108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a1bae8-1772-4b23-9374-dddd42fe2fc9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.822081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07531006-3214-4c1a-80a4-729bc8cecea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.822245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.822739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.822864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07531006-3214-4c1a-80a4-729bc8cecea3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.823016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.823130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07531006-3214-4c1a-80a4-729bc8cecea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.823283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.823376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07531006-3214-4c1a-80a4-729bc8cecea3 admin admin] PATH_INFO: `/v3/projects/1044bd8ab432422696720941c52bb33c/users/a0bb7478ca5746e98e02d76342a0dae0/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.823917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.825247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07531006-3214-4c1a-80a4-729bc8cecea3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1044bd8ab432422696720941c52bb33c, user_id=a0bb7478ca5746e98e02d76342a0dae0, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.825563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.827870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07531006-3214-4c1a-80a4-729bc8cecea3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.835209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1014/2014] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:20.836007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.837781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.841266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1001/2015] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:20 2022] PUT /identity/v3/projects/1044bd8ab432422696720941c52bb33c/users/a0bb7478ca5746e98e02d76342a0dae0/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:20.842501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c859-dc73-437c-84cc-857af73a77cf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.842783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c859-dc73-437c-84cc-857af73a77cf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.843061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c859-dc73-437c-84cc-857af73a77cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.853959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f578f1-8894-49c9-bc9e-eb08bfcf6ad4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.873035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:20.875693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a228c859-dc73-437c-84cc-857af73a77cf None None] MFA Rules not processed for user `490c592e64114e4b87e7ff2737ac166e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:20.876944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a228c859-dc73-437c-84cc-857af73a77cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.913885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39408d8-d742-4236-9a09-f48d1c72fdf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.914490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39408d8-d742-4236-9a09-f48d1c72fdf2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.914777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39408d8-d742-4236-9a09-f48d1c72fdf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.915323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39408d8-d742-4236-9a09-f48d1c72fdf2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.915994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39408d8-d742-4236-9a09-f48d1c72fdf2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.917643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39408d8-d742-4236-9a09-f48d1c72fdf2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:20.931922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1015/2016] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:20.931922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.931922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.931922 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.950609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:20.951830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.960468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1016/2017] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:20.961327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:20.968638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:20.972432 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1002/2018] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:20.973740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.974026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.974300 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.983866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566b8387-28a9-47d6-acfc-ec7665d7c60f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:20.988887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:20.989503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:20.989787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:20.990059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:20.990714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:20.993137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.005078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1017/2019] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:20 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:21.006101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.016459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] MFA Rules not processed for user `a0bb7478ca5746e98e02d76342a0dae0`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:21.017432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5afd57-88aa-4145-a517-17216e1fcdf4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.017676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.023513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0002f9-3634-4fb8-8719-d3a455ca5f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.024440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0002f9-3634-4fb8-8719-d3a455ca5f32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.024722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0002f9-3634-4fb8-8719-d3a455ca5f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.025005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0002f9-3634-4fb8-8719-d3a455ca5f32 admin admin] PATH_INFO: `/v3/projects/60f856a56ac64412bc17e1d74258ad80/users/cebc4433a88b4ce0803def1bce7028f9/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.042206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0002f9-3634-4fb8-8719-d3a455ca5f32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f856a56ac64412bc17e1d74258ad80, user_id=cebc4433a88b4ce0803def1bce7028f9, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.044900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0002f9-3634-4fb8-8719-d3a455ca5f32 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.064493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1018/2020] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:21 2022] PUT /identity/v3/projects/60f856a56ac64412bc17e1d74258ad80/users/cebc4433a88b4ce0803def1bce7028f9/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:21.065788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.066245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.066534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.093109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:21.095080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.113725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1003/2021] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:20 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:21.114784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.129550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.165276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1019/2022] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:21.166053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.176723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5520cc5e-981b-4372-ba23-411165a6d63b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.182040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.182855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.183326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.183700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] PATH_INFO: `/v3/projects/e511697fcdf040e29b090e4f34c5670b/users/20ccba2f9b8c466b9eb85fb2a00681be/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.196640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:21.202242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e511697fcdf040e29b090e4f34c5670b, user_id=20ccba2f9b8c466b9eb85fb2a00681be, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.205179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.212018 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c49758-3e0d-47fd-a4e3-20c257a490e6 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.227206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1020/2023] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:21 2022] PUT /identity/v3/projects/e511697fcdf040e29b090e4f34c5670b/users/20ccba2f9b8c466b9eb85fb2a00681be/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:21.228061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.270965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.271576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.271857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.272166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.285163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:21.298395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b397b0-e863-44cc-8054-73904ce64a36 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.303644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.304312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.304711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.304975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.305646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.307354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.318743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1021/2024] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:21.319695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.321532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.348625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.351307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.363522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1004/2025] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 249 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:21.364478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.377492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1c830c-db5a-4049-a81a-53b997af1135 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.383438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.384077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.385026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.385315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.385970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:21.386278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.387865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb4033-9114-43dc-a20e-c0e298124f80 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.388224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e43661bb-4afa-4309-9e04-3c7bda83a8cb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.394648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.395389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.396227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.397032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.402583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.408448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1005/2026] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:21.410145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.411882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.411882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.463608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] MFA Rules not processed for user `20ccba2f9b8c466b9eb85fb2a00681be`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:21.466102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.498088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.499949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.511651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1022/2027] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:21.512500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.527057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83fca632-a88c-4fb0-8f8e-48e56736a0d6 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.534205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.535169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.535587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.535872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] PATH_INFO: `/v3/projects/60f856a56ac64412bc17e1d74258ad80/users/cebc4433a88b4ce0803def1bce7028f9/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.538459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60f856a56ac64412bc17e1d74258ad80, user_id=cebc4433a88b4ce0803def1bce7028f9, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.541582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.555329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1006/2028] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:21.556191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.559906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1023/2029] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:21 2022] PUT /identity/v3/projects/60f856a56ac64412bc17e1d74258ad80/users/cebc4433a88b4ce0803def1bce7028f9/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:21.561470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.598097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbac6fea-b2e8-42f9-b70c-58131486ac3e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.650012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95e5cead-3291-4c05-811f-3faa8882b788 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.652743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:21.653941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.654626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.654927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.655169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.666840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:21.701835 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.702372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.702696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.703006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.704092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.706330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.738044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:21.748544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1007/2030] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:21 2022] POST /identity/v3/projects => generated 371 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:21.750203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.759720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.761545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.789205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1024/2031] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:21 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:21.790383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.809852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aa1f6e-28d2-4f12-b1c7-194e1392b58d service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.850271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22babd-fe7c-44ff-812f-fd33fa95d02f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:21.871215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.872067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.872470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.872958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.873767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.884285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:21.968864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1008/2032] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:21 2022] POST /identity/v3/projects => generated 375 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:21.970849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:21.972187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:21.973313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:21.973770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:21.974219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:21.975015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:21.981299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.044452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1025/2033] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:21 2022] POST /identity/v3/users => generated 286 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:22.045356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.061562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed47be9c-4207-4b4b-a3d7-5ede4f536f3e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.162791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.164402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.164879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.165217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.165957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.168512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.186320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1026/2034] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:22.187408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.190522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d57afc5-2fc6-4475-b583-8749d51e716f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.198025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.198651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.199089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.199657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.200498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.202064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e24e8b5-a817-438a-addc-daf07c04d218 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.202947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.208883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.210326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.211061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.211700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.212655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.214662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.242237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1027/2035] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:22.243887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.247911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1009/2036] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:21 2022] POST /identity/v3/users => generated 294 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:22.250286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.264368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb43fbab-28d5-4a69-b894-bafbb3987ce2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.273992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d84de4-ec2f-4529-bfc6-739a489c0f17 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.280572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.281731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-066ff582-344d-4bde-873b-3b74350dec31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.282002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.282257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff582-344d-4bde-873b-3b74350dec31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.282533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff582-344d-4bde-873b-3b74350dec31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.282805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066ff582-344d-4bde-873b-3b74350dec31 admin admin] PATH_INFO: `/v3/projects/989ebd4aafc14e61a7c3ac10b2348623/users/048aa94dc02744df829735c63eb89b89/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.283090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.283806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.284693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.286865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.301926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1010/2037] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:22.306966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.321917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff582-344d-4bde-873b-3b74350dec31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=989ebd4aafc14e61a7c3ac10b2348623, user_id=048aa94dc02744df829735c63eb89b89, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.325949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fbdcee-6c7a-40cb-a4a1-98c7d5a71f12 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.330848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-066ff582-344d-4bde-873b-3b74350dec31 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.349176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.350060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.350382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.350697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] PATH_INFO: `/v3/projects/9c1403dba837457096b8c1a092369e96/users/1ea4d5d38901460cae2f71e88a7e4997/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.367477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1028/2038] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:22 2022] PUT /identity/v3/projects/989ebd4aafc14e61a7c3ac10b2348623/users/048aa94dc02744df829735c63eb89b89/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:22.380353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:22.381522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.388282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1403dba837457096b8c1a092369e96, user_id=1ea4d5d38901460cae2f71e88a7e4997, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.391587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.391906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.392072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.419454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1011/2039] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:22 2022] PUT /identity/v3/projects/9c1403dba837457096b8c1a092369e96/users/1ea4d5d38901460cae2f71e88a7e4997/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:22.424611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.473032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] MFA Rules not processed for user `048aa94dc02744df829735c63eb89b89`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:22.473032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:22.522900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:22.593939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f11a14-8806-4985-a60e-2b3c404493f8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.599007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1029/2040] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:22.612327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.612917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.613726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:22.614065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.614545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.615020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.615874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.618442 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.640806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1012/2041] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:22.644870 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.660112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ff73c9-caf8-43f0-8b30-fff83a24da45 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.672452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d049ef9-d9d2-414e-ae05-56823c9c6d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.673521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049ef9-d9d2-414e-ae05-56823c9c6d7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.674004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049ef9-d9d2-414e-ae05-56823c9c6d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.674476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d049ef9-d9d2-414e-ae05-56823c9c6d7e admin admin] PATH_INFO: `/v3/projects/9c1403dba837457096b8c1a092369e96/users/1ea4d5d38901460cae2f71e88a7e4997/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.676767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049ef9-d9d2-414e-ae05-56823c9c6d7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c1403dba837457096b8c1a092369e96, user_id=1ea4d5d38901460cae2f71e88a7e4997, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.680379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d049ef9-d9d2-414e-ae05-56823c9c6d7e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.695478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1013/2042] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:22 2022] PUT /identity/v3/projects/9c1403dba837457096b8c1a092369e96/users/1ea4d5d38901460cae2f71e88a7e4997/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:22.705413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.706279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.706514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.719462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce65e4-7c57-47a7-9ea9-5dc1c7df2b69 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.760658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] MFA Rules not processed for user `1ea4d5d38901460cae2f71e88a7e4997`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:22.760658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:22.787539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f1ca09-5ad2-4aea-96c6-7029cd63e74a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.788437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ca09-5ad2-4aea-96c6-7029cd63e74a service glance] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.788824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ca09-5ad2-4aea-96c6-7029cd63e74a service glance] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.789847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f1ca09-5ad2-4aea-96c6-7029cd63e74a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.841134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1014/2043] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:22 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:22.853717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:22.864035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ca09-5ad2-4aea-96c6-7029cd63e74a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:22.865421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f1ca09-5ad2-4aea-96c6-7029cd63e74a service glance] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:22.876804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1030/2044] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:22.925086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7ca340-6c94-4bc6-bf22-174370596ec7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:22.945032 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:22.948485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:22.948485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:22.948485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:22.948485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:22.968780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:23.039213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:23.039769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:23.039769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:23.044531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:23.046596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6448f-a330-49bc-8945-fe5260cbc6b0 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:23.059302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1015/2045] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:22 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:23.081537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] MFA Rules not processed for user `cebc4433a88b4ce0803def1bce7028f9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:23.082869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:23.087252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:23.196088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1031/2046] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:23 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:23.202568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:23.202853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:23.203127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:23.230323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] MFA Rules not processed for user `88fa94e9cdaa473ba72d3af58cb05925`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:23.231649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:23.314883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1016/2047] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:23.324765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:23.326229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:23.451473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:23.463087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eacfc8-a46e-42f2-98c5-ce761ce0f04e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:23.466941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d57bf-6fe6-466a-b43a-c26b8a00f762 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:23.472922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:23.473898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:23.474251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:23.474380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:23.475170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:23.475278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:23.476264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:23.476635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:23.481852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:23.494739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:23.496954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:23.520211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1032/2048] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:23 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:23.549026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:23.550455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:23.562151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1017/2049] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:23 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:24.705462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:24.715479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750cf4ec-efa3-44c3-b472-06303fb2ffca service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:24.719349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:24.720207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:24.720637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:24.721059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:24.782656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:24.784111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:24.794422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1033/2050] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:24 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:25.423020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:25.424819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:25.496874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:25.514265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac329738-f1f4-4e03-8fbb-aeb580f3cb07 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:25.520244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:25.521004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:25.521458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:25.521790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] PATH_INFO: `/v3/users/c384e758c4e64944a33f04ea5e2a3226` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:25.524112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c384e758c4e64944a33f04ea5e2a3226)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:25.525459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:25.526454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:25.557684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3887d99-957f-42ee-8615-acf143bf3631 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:25.575953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2289eb04-08b8-4460-bdb2-3ab8c69cc0cf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:25.576619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289eb04-08b8-4460-bdb2-3ab8c69cc0cf service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:25.576891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289eb04-08b8-4460-bdb2-3ab8c69cc0cf service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:25.577199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2289eb04-08b8-4460-bdb2-3ab8c69cc0cf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:25.610109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c384e758c4e64944a33f04ea5e2a3226'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:25.612658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c384e758c4e64944a33f04ea5e2a3226'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:25.621972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289eb04-08b8-4460-bdb2-3ab8c69cc0cf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:25.623436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2289eb04-08b8-4460-bdb2-3ab8c69cc0cf service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:25.633224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c384e758c4e64944a33f04ea5e2a3226'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:25.647510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c384e758c4e64944a33f04ea5e2a3226'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:25.651052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1034/2051] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:25 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:25.679136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c384e758c4e64944a33f04ea5e2a3226'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:25.689258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1018/2052] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:25 2022] DELETE /identity/v3/users/c384e758c4e64944a33f04ea5e2a3226 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:25.694065 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:25.694884 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:25.695246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:25.737500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:25.739568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:25.773110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:25.872920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1035/2053] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:25.904942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:25.906482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:26.022244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc66e60-75f2-4b41-be2e-4ed56af3de9a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:26.026441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:26.027124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:26.027697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:26.028083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:26.064100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:26.068098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:26.083518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1019/2054] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:26.671581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:26.675440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:26.701668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac18e2e8-e0a7-42f9-92e7-5783e298bb8e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:26.710579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:26.711435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:26.711758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:26.713799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] PATH_INFO: `/v3/projects/b23d9db17da44599af6a23361d57e643` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:26.715341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23d9db17da44599af6a23361d57e643)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:26.719918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:26.842453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23d9db17da44599af6a23361d57e643', 'request_id': 'req-6c69e731-447e-4761-8a60-b07056a43d8c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:26.857335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23d9db17da44599af6a23361d57e643', 'request_id': 'req-6c69e731-447e-4761-8a60-b07056a43d8c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:26.869651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23d9db17da44599af6a23361d57e643', 'request_id': 'req-6c69e731-447e-4761-8a60-b07056a43d8c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:26.887755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] The token cache is being invalidate because project b23d9db17da44599af6a23361d57e643 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:26.888188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:26.889179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:26.891324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1036/2055] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:26 2022] DELETE /identity/v3/projects/b23d9db17da44599af6a23361d57e643 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:26.897976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:26.930946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a1ca52-d286-4af1-ad1d-5964f06ef5b2 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:27.042568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:27.043566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:27.043846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:27.044148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] PATH_INFO: `/v3/users/490c592e64114e4b87e7ff2737ac166e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:27.049215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] RBAC: Authorizing `identity:delete_user(user_id=490c592e64114e4b87e7ff2737ac166e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:27.052157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:27.083620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:27.147574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '490c592e64114e4b87e7ff2737ac166e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.148956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '490c592e64114e4b87e7ff2737ac166e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.174090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '490c592e64114e4b87e7ff2737ac166e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.185362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '490c592e64114e4b87e7ff2737ac166e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.196362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e33a00c9-5555-475d-851f-644707404a6e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '490c592e64114e4b87e7ff2737ac166e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.206746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1020/2056] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:26 2022] DELETE /identity/v3/users/490c592e64114e4b87e7ff2737ac166e => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:27.597756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:27.599994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:27.621073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c69e731-447e-4761-8a60-b07056a43d8c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:27.712352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:27.713135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:27.713529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:27.713903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] PATH_INFO: `/v3/users/fe4a2e9bbe5544c3bf268e2bbdb07886` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:27.715155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe4a2e9bbe5544c3bf268e2bbdb07886)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:27.717383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:27.763469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:27.776530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe4a2e9bbe5544c3bf268e2bbdb07886'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.779175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe4a2e9bbe5544c3bf268e2bbdb07886'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.791122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe4a2e9bbe5544c3bf268e2bbdb07886'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.816491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe4a2e9bbe5544c3bf268e2bbdb07886'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.855163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe4a2e9bbe5544c3bf268e2bbdb07886'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:27.864092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1037/2057] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:27 2022] DELETE /identity/v3/users/fe4a2e9bbe5544c3bf268e2bbdb07886 => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:27.868583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:27.868868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:27.869211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:27.896396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:27.898274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:27.951110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:27.951110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:27.984502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1021/2058] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:28.017274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.019437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:28.108556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffc6973-cfb7-40d7-8a09-64596b4b3871 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.115007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:28.115764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.116342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.116654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] PATH_INFO: `/v3/projects/924da98315734ec4a925fb26364397e3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.130380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] RBAC: Authorizing `identity:delete_project(project_id=924da98315734ec4a925fb26364397e3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:28.133466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:28.135787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f05b697-c436-4c9f-a5ed-a4f448d1b861 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.139546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882d709-be23-4000-a5d9-0884982d79fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:28.140209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d709-be23-4000-a5d9-0884982d79fa service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.140860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d709-be23-4000-a5d9-0884982d79fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.141138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882d709-be23-4000-a5d9-0884982d79fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.153043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d709-be23-4000-a5d9-0884982d79fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:28.154631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882d709-be23-4000-a5d9-0884982d79fa service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:28.166861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1022/2059] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:28.196395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '924da98315734ec4a925fb26364397e3', 'request_id': 'req-11311a05-f506-4775-981c-2b81ae0dc188'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.202821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '924da98315734ec4a925fb26364397e3', 'request_id': 'req-11311a05-f506-4775-981c-2b81ae0dc188'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.212195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '924da98315734ec4a925fb26364397e3', 'request_id': 'req-11311a05-f506-4775-981c-2b81ae0dc188'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.231008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] The token cache is being invalidate because project 924da98315734ec4a925fb26364397e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:28.231312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.231981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-11311a05-f506-4775-981c-2b81ae0dc188 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.235105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1038/2060] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:27 2022] DELETE /identity/v3/projects/924da98315734ec4a925fb26364397e3 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:28.239036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.239879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.240333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.270760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:28.273447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:28.315913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:28.362983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1023/2061] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:28.370879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.371260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.371610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.406093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:28.414380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:28.437012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1039/2062] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:28.443303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.454975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc04c841-8a1c-44ea-adc7-afadc7ad396a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.460874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:28.461697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.462345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.462345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.462897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:28.463207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:28.465050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:28.494601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1024/2063] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:28.498801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.510151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94dcafa-95e2-4539-a5b5-3ead085b6071 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.516187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:28.519426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.519426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.519426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.519426 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:28.520704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:28.590692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.593515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:28.614228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1040/2064] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:28 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:28.618566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.623638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0d1e88-c0fb-4c18-b2ef-b29aef76e2fc admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.674568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:28.781294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:28.782397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.782683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.782963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] PATH_INFO: `/v3/projects/d84fcf3ef9ca4a259e5adaa8596ff0ed` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.787658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d84fcf3ef9ca4a259e5adaa8596ff0ed)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:28.789896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:28.808449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1877b2f-0782-4f4d-90f2-7a75c91f9567 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.826675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:28.827555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:28.827990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:28.828529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:28.829345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:28.832219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:28.888818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1041/2065] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:28 2022] POST /identity/v3/users => generated 289 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:28.895037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.907849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd84fcf3ef9ca4a259e5adaa8596ff0ed', 'request_id': 'req-98d99791-bed0-464f-8c72-2600de8fcc52'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.908579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1539c7b-0e7f-40b5-b517-54bdcc705606 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:28.914322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd84fcf3ef9ca4a259e5adaa8596ff0ed', 'request_id': 'req-98d99791-bed0-464f-8c72-2600de8fcc52'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.930961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd84fcf3ef9ca4a259e5adaa8596ff0ed', 'request_id': 'req-98d99791-bed0-464f-8c72-2600de8fcc52'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.977928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] The token cache is being invalidate because project d84fcf3ef9ca4a259e5adaa8596ff0ed was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:28.978230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.979416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:28.981595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1025/2066] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:28 2022] DELETE /identity/v3/projects/d84fcf3ef9ca4a259e5adaa8596ff0ed => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:28.985471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:28.986881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:29.056494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:29.057322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.057879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.058908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.059695 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:29.064124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:29.109530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1042/2067] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:28 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:29.109530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:29.145436 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:29.169503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:29.192457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d99791-bed0-464f-8c72-2600de8fcc52 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:29.200497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:29.201470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.201994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.202488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] PATH_INFO: `/v3/users/a0bb7478ca5746e98e02d76342a0dae0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.203925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0bb7478ca5746e98e02d76342a0dae0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:29.206061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff322397-5b4e-4bf0-8a98-b6b02770c374 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:29.207471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:29.227676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:29.228440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.228822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.229092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.229868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:29.231644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:29.264183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1043/2068] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:29 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:29.265139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:29.296721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7255c35d-f9e9-4818-b98b-2f6b1cfb65d0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:29.312537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2b3fa4-1e10-4f7d-b504-77ae8a2e0ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:29.313352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b3fa4-1e10-4f7d-b504-77ae8a2e0ff3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.313633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b3fa4-1e10-4f7d-b504-77ae8a2e0ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.313935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2b3fa4-1e10-4f7d-b504-77ae8a2e0ff3 admin admin] PATH_INFO: `/v3/projects/6f57745a62ff4420a19beafe007ed900/users/2c47100284f94d4496c0b98ceca0c827/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.350232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0bb7478ca5746e98e02d76342a0dae0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:29.351380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0bb7478ca5746e98e02d76342a0dae0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:29.355530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b3fa4-1e10-4f7d-b504-77ae8a2e0ff3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6f57745a62ff4420a19beafe007ed900, user_id=2c47100284f94d4496c0b98ceca0c827, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:29.359067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2b3fa4-1e10-4f7d-b504-77ae8a2e0ff3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:29.383554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0bb7478ca5746e98e02d76342a0dae0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:29.396223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0bb7478ca5746e98e02d76342a0dae0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:29.403831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1044/2069] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:29 2022] PUT /identity/v3/projects/6f57745a62ff4420a19beafe007ed900/users/2c47100284f94d4496c0b98ceca0c827/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:29.415774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.416194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.416942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.433296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0bb7478ca5746e98e02d76342a0dae0'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:29.464693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1026/2070] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:28 2022] DELETE /identity/v3/users/a0bb7478ca5746e98e02d76342a0dae0 => generated 0 bytes in 480 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:29.496795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] MFA Rules not processed for user `2c47100284f94d4496c0b98ceca0c827`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:29.499265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:29.617717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:29.641587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1045/2071] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:29 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:29.642521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:29.644995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:29.817028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcf627-d70d-4d65-9a42-b8e36e6683ad admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:29.823996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:29.825246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.825536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.825942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.826605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:29.828719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:29.871067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1027/2072] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:29 2022] POST /identity/v3/projects => generated 375 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:29.873524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:29.890811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae18d24d-b693-4423-b26c-d7d52ff4942a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:29.997170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:29.997794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:29.998071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:29.998342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:29.999432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.001565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.064217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1046/2073] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:29 2022] POST /identity/v3/users => generated 294 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:30.065889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.079193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-176131b5-5a68-4ffb-b693-97a7b8b375e3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.081887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.088317 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.099303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.100245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.101366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.101647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.102445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.104876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78785ec2-ef15-4962-8043-e3a81197e0df admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.114964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.129551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.130564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.131617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.132678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1028/2074] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:30.133400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] PATH_INFO: `/v3/projects/1044bd8ab432422696720941c52bb33c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.137313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.138223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=1044bd8ab432422696720941c52bb33c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.140418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.157319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f24b6-ef50-4ea4-bf29-749fc50686b0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.167947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.170487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.170909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.171295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] PATH_INFO: `/v3/projects/38a3855294324a32a6a29cf691be91b2/users/9f7568696b59417383d17cd275e3b46f/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.206423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a3855294324a32a6a29cf691be91b2, user_id=9f7568696b59417383d17cd275e3b46f, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.215846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.243382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1029/2075] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:30 2022] PUT /identity/v3/projects/38a3855294324a32a6a29cf691be91b2/users/9f7568696b59417383d17cd275e3b46f/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:30.247619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.250732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1044bd8ab432422696720941c52bb33c', 'request_id': 'req-49143830-eb2d-4d5e-a877-0c47757af4bf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.258121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1044bd8ab432422696720941c52bb33c', 'request_id': 'req-49143830-eb2d-4d5e-a877-0c47757af4bf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.270172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1044bd8ab432422696720941c52bb33c', 'request_id': 'req-49143830-eb2d-4d5e-a877-0c47757af4bf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.279670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:30.288957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] The token cache is being invalidate because project 1044bd8ab432422696720941c52bb33c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:30.289319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.289973 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-49143830-eb2d-4d5e-a877-0c47757af4bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.293347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1047/2076] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:30 2022] DELETE /identity/v3/projects/1044bd8ab432422696720941c52bb33c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:30.297265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9a4d4-ba8b-4ccf-83ac-b45b436d27e1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.308532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9a4d4-ba8b-4ccf-83ac-b45b436d27e1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.308827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac9a4d4-ba8b-4ccf-83ac-b45b436d27e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.340378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb0f5dd-434b-4180-9fc8-35af5cd21052 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.350040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.350908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.351270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.352596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.353421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.355171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.355737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4ac9a4d4-ba8b-4ccf-83ac-b45b436d27e1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:30.361241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4ac9a4d4-ba8b-4ccf-83ac-b45b436d27e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.372256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1030/2077] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:30 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:30.389419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1048/2078] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:30.389891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.391346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.391817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.391946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.392389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.406887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659c5be9-027b-44f8-93b9-3a820de05288 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.413809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e7371a-2832-4f64-ad37-b1289269413e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.414787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7371a-2832-4f64-ad37-b1289269413e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.415393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7371a-2832-4f64-ad37-b1289269413e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.415960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e7371a-2832-4f64-ad37-b1289269413e admin admin] PATH_INFO: `/v3/projects/38a3855294324a32a6a29cf691be91b2/users/9f7568696b59417383d17cd275e3b46f/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.418662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7371a-2832-4f64-ad37-b1289269413e admin admin] RBAC: Authorizing `identity:create_grant(project_id=38a3855294324a32a6a29cf691be91b2, user_id=9f7568696b59417383d17cd275e3b46f, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.422267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e7371a-2832-4f64-ad37-b1289269413e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.422803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:30.424107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.434664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1049/2079] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:30.437188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1031/2080] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:30 2022] PUT /identity/v3/projects/38a3855294324a32a6a29cf691be91b2/users/9f7568696b59417383d17cd275e3b46f/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:30.446262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.449582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.449868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.450142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.461496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001aedc-1f36-4673-a4d9-c7976f57a6f7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.488494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] MFA Rules not processed for user `9f7568696b59417383d17cd275e3b46f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:30.490076 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.589838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:30.610427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.611405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.611743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.612189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.612937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:30.613594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.617923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.619907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1032/2081] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:30 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:30.621029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.622321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.631090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1050/2082] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:30.632482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.634086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.649271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ea243e-a9f2-4af3-862f-4f1e63b461a5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.653579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.654254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.654534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.654806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] PATH_INFO: `/v3/users/140a5d7204414d99a8d0114e265ece13` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.655958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] RBAC: Authorizing `identity:delete_user(user_id=140a5d7204414d99a8d0114e265ece13)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.657895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.701628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bae3fc59-4eb7-49a7-b773-6f4a12128b99 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.706416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.707031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.707312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.707589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.708714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '140a5d7204414d99a8d0114e265ece13'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.709355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.710114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '140a5d7204414d99a8d0114e265ece13'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.725397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '140a5d7204414d99a8d0114e265ece13'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.733295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '140a5d7204414d99a8d0114e265ece13'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.742611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '140a5d7204414d99a8d0114e265ece13'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:30.749938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1033/2083] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:30 2022] DELETE /identity/v3/users/140a5d7204414d99a8d0114e265ece13 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:30.750764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.754188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.760259 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:30.788774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.790414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8212188-3bd6-469d-8ab7-51f121136ba0 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.800670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1051/2084] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:30 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:30.802002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.802283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.802551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.827551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:30.828798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.838419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b494242-fdf0-4e6d-b64e-8d58622dc691 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.841284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1052/2085] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:30.847104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.847728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.848148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.848428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:30.849056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:30.851421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:30.852713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.857326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:30.892213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1034/2086] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:30 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:30.895940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:30.958493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7816b8e1-2ca6-4a61-9608-e0615e227d83 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.990386 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418624e6-18b3-494b-abc4-63f4292d7254 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:30.996396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:30.998149 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:30.998439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:30.999306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.002707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.003509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.016181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.016987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.017196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.017482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.029356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1035/2087] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:30 2022] POST /identity/v3/users => generated 284 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:31.029699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:31.032240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.033510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.033928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.046891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a007cd0b-33f0-4ac8-b295-a44e6a57c57b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.051775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1053/2088] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:31.053991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.054731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.055221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.055468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.056319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.058138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.074187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1036/2089] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:31.078252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.090313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084aeb34-205d-4092-926d-8c039d1789df service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.096833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6597a0c1-1c45-40c5-a7fe-6696407a8858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.097446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597a0c1-1c45-40c5-a7fe-6696407a8858 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.097730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597a0c1-1c45-40c5-a7fe-6696407a8858 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.098035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6597a0c1-1c45-40c5-a7fe-6696407a8858 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.100199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597a0c1-1c45-40c5-a7fe-6696407a8858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.103116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6597a0c1-1c45-40c5-a7fe-6696407a8858 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.123954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1054/2090] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:31.124945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.137930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adca4c3-63b4-43b6-93bf-cc05cac7512c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.142739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.143501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.146419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.146419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] PATH_INFO: `/v3/projects/80c1375f54714e6cbe1428e1f1b3827c/users/cb63fa45eded4ef885548d1ac59be71a/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.169238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=80c1375f54714e6cbe1428e1f1b3827c, user_id=cb63fa45eded4ef885548d1ac59be71a, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.172280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.197499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1037/2091] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:31 2022] PUT /identity/v3/projects/80c1375f54714e6cbe1428e1f1b3827c/users/cb63fa45eded4ef885548d1ac59be71a/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:31.207457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.207808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.208008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.254818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] MFA Rules not processed for user `cb63fa45eded4ef885548d1ac59be71a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:31.256935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:31.339815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1055/2092] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:31 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:31.344950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.396010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:31.422251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce4c3b-5851-43e9-b235-f3d034929e6f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.428760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.429454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.429821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.430625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.430878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.433020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.464371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1038/2093] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:31 2022] POST /identity/v3/projects => generated 367 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:31.468607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.474004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.475949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:31.494031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf735c-c465-4647-8503-7fe34af689b1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.573066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e36700f3-7e3f-4ad2-8957-a8703322ffed admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.579838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.580550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.580834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.581109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] PATH_INFO: `/v3/projects/83af72e84b4346a7b67b5dc2a4f17fc4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.582270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83af72e84b4346a7b67b5dc2a4f17fc4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.584374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.586109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.587118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.587628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.588636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.589608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.591770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.629834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1056/2094] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:31 2022] POST /identity/v3/users => generated 290 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:31.634562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.647732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6558e30-b4e7-44fe-8751-fae96cffd908 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.653389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.654160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.654586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.655038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.656034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.659492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.672003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1057/2095] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:31.677393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.692848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7161ead-c12d-4c2f-9c50-14c9ea747f4b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.695393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83af72e84b4346a7b67b5dc2a4f17fc4', 'request_id': 'req-0122ee50-2b9c-47f9-93bc-525fb55b8e50'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:31.705684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83af72e84b4346a7b67b5dc2a4f17fc4', 'request_id': 'req-0122ee50-2b9c-47f9-93bc-525fb55b8e50'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:31.714320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83af72e84b4346a7b67b5dc2a4f17fc4', 'request_id': 'req-0122ee50-2b9c-47f9-93bc-525fb55b8e50'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:31.732336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] The token cache is being invalidate because project 83af72e84b4346a7b67b5dc2a4f17fc4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:31.732641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:31.733938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:31.737267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1039/2096] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:31 2022] DELETE /identity/v3/projects/83af72e84b4346a7b67b5dc2a4f17fc4 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:31.741400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.746995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:31.759632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:31.771976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.773030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.773543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.774020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] PATH_INFO: `/v3/projects/6880cd09a0324b17a1f42e57099b69c4/users/123b4b239de54583bb07727dd90d16b6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.790631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6880cd09a0324b17a1f42e57099b69c4, user_id=123b4b239de54583bb07727dd90d16b6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.793380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.815515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:31.822429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1058/2097] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:31 2022] PUT /identity/v3/projects/6880cd09a0324b17a1f42e57099b69c4/users/123b4b239de54583bb07727dd90d16b6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:31.822644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0122ee50-2b9c-47f9-93bc-525fb55b8e50 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.824428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.826196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:31.943841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.945743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.946790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.947079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] PATH_INFO: `/v3/users/20ccba2f9b8c466b9eb85fb2a00681be` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.948582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=20ccba2f9b8c466b9eb85fb2a00681be)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.951378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.956680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1580874b-af9a-4ab4-973e-1703deefdaa3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:31.962173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:31.962907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:31.963055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:31.963410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:31.964119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:31.966427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:31.977336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1059/2098] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:31 2022] GET /identity/v3/roles => generated 1420 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:31.981552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:31.997120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b4b6bd-0a1c-4728-8abd-83daf02eea2b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:32.002360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f71423-89eb-4f65-bcb5-273aded2bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:32.003016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f71423-89eb-4f65-bcb5-273aded2bca3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:32.003295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f71423-89eb-4f65-bcb5-273aded2bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:32.003811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f71423-89eb-4f65-bcb5-273aded2bca3 admin admin] PATH_INFO: `/v3/projects/6880cd09a0324b17a1f42e57099b69c4/users/123b4b239de54583bb07727dd90d16b6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:32.005827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f71423-89eb-4f65-bcb5-273aded2bca3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6880cd09a0324b17a1f42e57099b69c4, user_id=123b4b239de54583bb07727dd90d16b6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:32.009164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f71423-89eb-4f65-bcb5-273aded2bca3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:32.016720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '20ccba2f9b8c466b9eb85fb2a00681be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.017410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '20ccba2f9b8c466b9eb85fb2a00681be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.022989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1060/2099] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:31 2022] PUT /identity/v3/projects/6880cd09a0324b17a1f42e57099b69c4/users/123b4b239de54583bb07727dd90d16b6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:32.033045 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:32.033564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:32.033739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:32.036319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '20ccba2f9b8c466b9eb85fb2a00681be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.046127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '20ccba2f9b8c466b9eb85fb2a00681be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.055138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '20ccba2f9b8c466b9eb85fb2a00681be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.061363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1040/2100] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:31 2022] DELETE /identity/v3/users/20ccba2f9b8c466b9eb85fb2a00681be => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:32.070555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] MFA Rules not processed for user `123b4b239de54583bb07727dd90d16b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:32.071984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:32.197167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1061/2101] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:32 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:32.211239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:32.213671 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:32.311384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4058786-8392-4745-a614-624dd91afb59 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:32.315352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:32.316301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:32.316736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:32.317144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:32.329488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:32.332414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:32.348616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1041/2102] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:32 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:32.575977 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:32.587721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6115f7-c105-4b5d-bfb0-462a5d2598f7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:32.608180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:32.608821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:32.609106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:32.609623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:32.612127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:32.687313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:32.715320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:32.717387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:32.729613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:32.730912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:32.744528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1062/2103] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:32 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:32.799212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:32.856953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10013668-412b-43d7-8bd4-20080826a121 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:32.863966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:32.865371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:32.866684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:32.867243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] PATH_INFO: `/v3/projects/e511697fcdf040e29b090e4f34c5670b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:32.869495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] RBAC: Authorizing `identity:delete_project(project_id=e511697fcdf040e29b090e4f34c5670b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:32.871885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:32.962075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e511697fcdf040e29b090e4f34c5670b', 'request_id': 'req-3c364ba3-91b8-4811-9a57-7e8baf85624a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.972236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e511697fcdf040e29b090e4f34c5670b', 'request_id': 'req-3c364ba3-91b8-4811-9a57-7e8baf85624a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.981115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e511697fcdf040e29b090e4f34c5670b', 'request_id': 'req-3c364ba3-91b8-4811-9a57-7e8baf85624a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:32.999662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] The token cache is being invalidate because project e511697fcdf040e29b090e4f34c5670b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:33.000645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.001601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.007009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1042/2104] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:32 2022] DELETE /identity/v3/projects/e511697fcdf040e29b090e4f34c5670b => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:33.008434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:33.028205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850d0702-54eb-49f7-9aad-fb7ffcbeb78c service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:33.138012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:33.138660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:33.138969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:33.139254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] PATH_INFO: `/v3/users/1ea4d5d38901460cae2f71e88a7e4997` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:33.141362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ea4d5d38901460cae2f71e88a7e4997)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:33.144262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:33.234772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ea4d5d38901460cae2f71e88a7e4997'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.236645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ea4d5d38901460cae2f71e88a7e4997'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.256025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ea4d5d38901460cae2f71e88a7e4997'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.265483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ea4d5d38901460cae2f71e88a7e4997'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.279707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ea4d5d38901460cae2f71e88a7e4997'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.286160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1063/2105] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:33 2022] DELETE /identity/v3/users/1ea4d5d38901460cae2f71e88a7e4997 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:33.594276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:33.596172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:33.611325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c364ba3-91b8-4811-9a57-7e8baf85624a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:33.678644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:33.679282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:33.679559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:33.679831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] PATH_INFO: `/v3/projects/9c1403dba837457096b8c1a092369e96` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:33.680989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c1403dba837457096b8c1a092369e96)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:33.683289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:33.686389 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:33.687796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:33.745088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c1403dba837457096b8c1a092369e96', 'request_id': 'req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.751786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c1403dba837457096b8c1a092369e96', 'request_id': 'req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.754548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:33.760069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c31667-b16d-4ed9-8232-85b9c265fc3c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:33.760351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c1403dba837457096b8c1a092369e96', 'request_id': 'req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.777021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:33.784192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] The token cache is being invalidate because project 9c1403dba837457096b8c1a092369e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:33.784483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.785121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-d027f89d-4cd2-4dbf-97e4-0aa06489dd30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:33.786842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1043/2106] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:33 2022] DELETE /identity/v3/projects/9c1403dba837457096b8c1a092369e96 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:33.791810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3898-8526-4b2f-96ea-14e1958ad2bb None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:33.792209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3898-8526-4b2f-96ea-14e1958ad2bb None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:33.792380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04b3898-8526-4b2f-96ea-14e1958ad2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:33.814607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f04b3898-8526-4b2f-96ea-14e1958ad2bb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:33.816162 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f04b3898-8526-4b2f-96ea-14e1958ad2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:33.866131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:33.867037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:33.867488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:33.869870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:33.874101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:33.936753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1044/2107] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:33.953374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:33.953914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:33.954389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:33.977228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:33.978454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:33.986775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1045/2108] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:33.989865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:33.991802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:33.991972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.001548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e96d4eb-2a9f-4e04-a470-35acb46b20ec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.007720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.008010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1064/2109] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:33 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:34.008324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.008609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.008881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.009531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:34.009899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.011497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.027806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1046/2110] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:34.033170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:34.045603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7158e7-748a-4222-8cc1-7f936b914278 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.050843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.051500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.051784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.052081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.052705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.055456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.083762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1065/2111] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:34 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:34.088329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:34.098878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a7fc3c-a57b-49ab-9514-987259c14966 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.160266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.161035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.161316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.161587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.162218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.164409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.190905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1047/2112] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:34 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:34.192363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:34.214562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd62d3d5-8e0c-405b-85b3-0683458bf9b1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.219260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.219863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.220911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.221193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.221847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.223490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.237869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1066/2113] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:34.241575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:34.252211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe82ae2-4369-4ef7-9c32-a878a43a4d1b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.258807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ced6ebf-fedb-4db9-b2fc-882f037a48d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.259403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced6ebf-fedb-4db9-b2fc-882f037a48d6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.259890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced6ebf-fedb-4db9-b2fc-882f037a48d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.260207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ced6ebf-fedb-4db9-b2fc-882f037a48d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.260863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced6ebf-fedb-4db9-b2fc-882f037a48d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.263039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ced6ebf-fedb-4db9-b2fc-882f037a48d6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.275357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1048/2114] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:34 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:34.279569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:34.294120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509b9a45-2f69-494f-a113-d27f7ae71a73 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.300840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.301757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.302040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.302318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] PATH_INFO: `/v3/projects/3474c915ba2b427fb21c1e0f76050f70/users/bf1dce062f474d85bea4e5536b163f81/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.326490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3474c915ba2b427fb21c1e0f76050f70, user_id=bf1dce062f474d85bea4e5536b163f81, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.329593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.349599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1067/2115] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:34 2022] PUT /identity/v3/projects/3474c915ba2b427fb21c1e0f76050f70/users/bf1dce062f474d85bea4e5536b163f81/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:34.362373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.362855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.363086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.437730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] MFA Rules not processed for user `bf1dce062f474d85bea4e5536b163f81`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:34.439144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:34.491335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:34.558127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1049/2116] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:34 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:34.570106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:34.572530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:34.676782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b02b12-47b7-444c-ba0a-b32aaee295c0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:34.681611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b56e988-1eb8-49a0-a157-51bf115f3f63 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:34.682331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56e988-1eb8-49a0-a157-51bf115f3f63 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:34.682627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56e988-1eb8-49a0-a157-51bf115f3f63 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:34.682905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b56e988-1eb8-49a0-a157-51bf115f3f63 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:34.693017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56e988-1eb8-49a0-a157-51bf115f3f63 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:34.696221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b56e988-1eb8-49a0-a157-51bf115f3f63 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:34.706516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1068/2117] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:34 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:37.379763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:37.448025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551c9895-3e49-40a7-b363-9f4a1734aa05 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:37.453224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:37.453863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:37.454144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:37.454540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] PATH_INFO: `/v3/users/bf1dce062f474d85bea4e5536b163f81` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:37.455693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf1dce062f474d85bea4e5536b163f81)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:37.457716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:37.508798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf1dce062f474d85bea4e5536b163f81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:37.509468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf1dce062f474d85bea4e5536b163f81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:37.526743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf1dce062f474d85bea4e5536b163f81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:37.536867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf1dce062f474d85bea4e5536b163f81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:37.544840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf1dce062f474d85bea4e5536b163f81'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:37.553008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1050/2118] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:37 2022] DELETE /identity/v3/users/bf1dce062f474d85bea4e5536b163f81 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:37.557118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c086-5424-4314-888f-b4ca21669baa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:37.557118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c086-5424-4314-888f-b4ca21669baa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:37.557613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8142c086-5424-4314-888f-b4ca21669baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:37.579489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8142c086-5424-4314-888f-b4ca21669baa None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:37.580845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8142c086-5424-4314-888f-b4ca21669baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:37.589794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:37.653488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1069/2119] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:37.663421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:37.665050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:37.727298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42067fb-f987-42aa-89f8-967def6c9150 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:37.731365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7599fabf-e243-4477-83e9-b100942716b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:37.732117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599fabf-e243-4477-83e9-b100942716b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:37.732525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599fabf-e243-4477-83e9-b100942716b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:37.732900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7599fabf-e243-4477-83e9-b100942716b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:37.743577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599fabf-e243-4477-83e9-b100942716b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:37.745482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7599fabf-e243-4477-83e9-b100942716b7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:37.750118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:37.764947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1051/2120] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:38.116226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142c086-5424-4314-888f-b4ca21669baa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.117751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8142c086-5424-4314-888f-b4ca21669baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.140139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8142c086-5424-4314-888f-b4ca21669baa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.148730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.149510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.150043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.150327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] PATH_INFO: `/v3/projects/3474c915ba2b427fb21c1e0f76050f70` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.154489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3474c915ba2b427fb21c1e0f76050f70)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.154489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.211337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3474c915ba2b427fb21c1e0f76050f70', 'request_id': 'req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.219606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3474c915ba2b427fb21c1e0f76050f70', 'request_id': 'req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.232032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3474c915ba2b427fb21c1e0f76050f70', 'request_id': 'req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.253649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] The token cache is being invalidate because project 3474c915ba2b427fb21c1e0f76050f70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:38.254740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.256592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7fc83d5a-f0d9-4aaa-8618-e80363b5b0f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.259293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1070/2121] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:38 2022] DELETE /identity/v3/projects/3474c915ba2b427fb21c1e0f76050f70 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:38.264353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.264611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.264916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.290102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:38.292014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.381791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1052/2122] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:38.390026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.390535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.391546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.439125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:38.439125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.440545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.441869 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.449459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1071/2123] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:38.453831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.466546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5563e73c-0560-48f3-88c2-0ac11397e190 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.471474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4c204d-59a6-4952-98cc-8b844e1bdd21 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.472457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.473148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.473495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.473836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.475776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:38.475776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.478068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.481083 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.481733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.482016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.482343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] PATH_INFO: `/v3/users/cb63fa45eded4ef885548d1ac59be71a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.484749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb63fa45eded4ef885548d1ac59be71a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.487132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.495895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1072/2124] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:38.497644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.517917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a7bdd2-1a2c-4b1c-b9bc-d5f70e27fece admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.523988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.524900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.525187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.525507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.526264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.528268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.565057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1073/2125] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:38 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:38.569820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.571670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb63fa45eded4ef885548d1ac59be71a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.572506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb63fa45eded4ef885548d1ac59be71a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.586933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb63fa45eded4ef885548d1ac59be71a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.600924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb63fa45eded4ef885548d1ac59be71a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.611972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5399ad10-2559-403f-a922-b01be94ba35d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb63fa45eded4ef885548d1ac59be71a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:38.622161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1053/2126] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:38 2022] DELETE /identity/v3/users/cb63fa45eded4ef885548d1ac59be71a => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:38.627643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.627933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.628367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.650500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:38.651725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.653001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:38.658634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced0ef26-6dd7-4204-8e47-9c4eac75044a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.730527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1054/2127] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:38.734122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.734691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.734970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.735239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.735875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.738490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.741225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.742759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.760986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:38.765640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1074/2128] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:38 2022] POST /identity/v3/users => generated 287 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:38.770931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.773209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:38.788824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76519f14-c255-495e-b816-2bafbc420827 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.797523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.798173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.798453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.798726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.799408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.801059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.813527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1075/2129] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:38.816831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.826738 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad57147-037e-4363-886f-76cd855dd54f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.828296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77982c77-9a28-45ef-9219-de4cfc042fc3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.830508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4e3e4d-f427-4cc5-a3c8-30adcd57115c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.831403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3e4d-f427-4cc5-a3c8-30adcd57115c service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.831403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3e4d-f427-4cc5-a3c8-30adcd57115c service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.831647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4e3e4d-f427-4cc5-a3c8-30adcd57115c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.837680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.837680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.839539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.839539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.840963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.842846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.843131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e3e4d-f427-4cc5-a3c8-30adcd57115c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.845182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4e3e4d-f427-4cc5-a3c8-30adcd57115c service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.855414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1076/2130] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:38 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:38.858998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:38.862103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1055/2131] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:38.870876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33517d58-db9f-42e2-b9fb-19cebcb88328 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:38.879052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:38.880091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.880347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.880624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] PATH_INFO: `/v3/projects/74070616859f43519d24f4e8bd7c28bd/users/6819f88e125545c1a273b1aef0d6609e/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.898058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] RBAC: Authorizing `identity:create_grant(project_id=74070616859f43519d24f4e8bd7c28bd, user_id=6819f88e125545c1a273b1aef0d6609e, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:38.904223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:38.922050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1077/2132] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:38 2022] PUT /identity/v3/projects/74070616859f43519d24f4e8bd7c28bd/users/6819f88e125545c1a273b1aef0d6609e/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:38.940141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:38.940141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:38.940141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:38.977221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] MFA Rules not processed for user `6819f88e125545c1a273b1aef0d6609e`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:38.978464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:39.111830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1056/2133] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:39.124468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:39.126897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:39.257031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f2f323-1322-4435-bf74-2a97bdcb170b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:39.265928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:39.266811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:39.267184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:39.267633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:39.291929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:39.294183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:39.313130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:39.314857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:39.315416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1078/2134] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:39 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:39.453637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7089f-c224-477e-9544-e8c167e19b74 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:39.463726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:39.464902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:39.465188 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:39.465713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] PATH_INFO: `/v3/projects/80c1375f54714e6cbe1428e1f1b3827c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:39.468376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] RBAC: Authorizing `identity:delete_project(project_id=80c1375f54714e6cbe1428e1f1b3827c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:39.483027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:39.564279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:39.586513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80c1375f54714e6cbe1428e1f1b3827c', 'request_id': 'req-08ea996f-c5dd-4945-b85e-0ce9e239237a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.603834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80c1375f54714e6cbe1428e1f1b3827c', 'request_id': 'req-08ea996f-c5dd-4945-b85e-0ce9e239237a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.614102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80c1375f54714e6cbe1428e1f1b3827c', 'request_id': 'req-08ea996f-c5dd-4945-b85e-0ce9e239237a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.646154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] The token cache is being invalidate because project 80c1375f54714e6cbe1428e1f1b3827c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:39.647797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.651412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.655201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1057/2135] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:39 2022] DELETE /identity/v3/projects/80c1375f54714e6cbe1428e1f1b3827c => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:39.660768 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:39.680329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb37cfa-8328-4a9d-ac1f-d7fea3f7fc6e service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:39.759175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:39.795940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:39.803312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:39.803691 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:39.803950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] PATH_INFO: `/v3/users/123b4b239de54583bb07727dd90d16b6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:39.806119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] RBAC: Authorizing `identity:delete_user(user_id=123b4b239de54583bb07727dd90d16b6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:39.808569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:39.883853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '123b4b239de54583bb07727dd90d16b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.884672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '123b4b239de54583bb07727dd90d16b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.910474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '123b4b239de54583bb07727dd90d16b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.947150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '123b4b239de54583bb07727dd90d16b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.986429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-7b196be0-b7f0-4ec8-8dc0-c67e4667904b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '123b4b239de54583bb07727dd90d16b6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:39.993532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1079/2136] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:39 2022] DELETE /identity/v3/users/123b4b239de54583bb07727dd90d16b6 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:40.368448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:40.369993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:40.392911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ea996f-c5dd-4945-b85e-0ce9e239237a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:40.473353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:40.473991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.474766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.475184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] PATH_INFO: `/v3/projects/6880cd09a0324b17a1f42e57099b69c4` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.476785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6880cd09a0324b17a1f42e57099b69c4)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:40.478612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:40.540901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6880cd09a0324b17a1f42e57099b69c4', 'request_id': 'req-e24b91b1-1ab1-4467-8244-aac28a483fe7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:40.548085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6880cd09a0324b17a1f42e57099b69c4', 'request_id': 'req-e24b91b1-1ab1-4467-8244-aac28a483fe7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:40.559258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6880cd09a0324b17a1f42e57099b69c4', 'request_id': 'req-e24b91b1-1ab1-4467-8244-aac28a483fe7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:40.576906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] The token cache is being invalidate because project 6880cd09a0324b17a1f42e57099b69c4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:40.577201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:40.577834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e24b91b1-1ab1-4467-8244-aac28a483fe7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:40.579549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1058/2137] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:40 2022] DELETE /identity/v3/projects/6880cd09a0324b17a1f42e57099b69c4 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:40.584991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.585288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.585560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.608382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:40.609304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:40.711544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1080/2138] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:40.719345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.719898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.720352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.754677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:40.756745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:40.765910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1059/2139] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:40.770685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:40.781204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7a30fe-af85-4d3f-8d61-6b8ea6a0b6a8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:40.788594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:40.789216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.789761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.790055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.790825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:40.791815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:40.793800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:40.812987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1081/2140] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:40.813844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:40.824937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5535cf-e652-438e-9c3c-e80b6815d640 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:40.830443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:40.831143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.831491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.831827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.832552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:40.835140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:40.870004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1060/2141] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:40 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:40.874761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:40.890100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8b54a-e854-4e2a-b89d-dbe29aef871e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:40.951163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:40.960831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:40.961458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:40.962223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:40.962510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:40.963357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:40.965453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:40.994253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1082/2142] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:40 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:40.995207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:41.009234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058dd1fb-000f-493a-b611-f9653625eb65 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:41.015786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:41.016785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:41.017100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:41.017429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:41.018096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:41.019774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:41.034648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1061/2143] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:40 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:41.038825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:41.057172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb73cd4-e745-42de-8e59-9daa57353b05 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:41.064060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814d4d69-26e5-41da-bb66-8fa071d0175b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:41.064898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4d69-26e5-41da-bb66-8fa071d0175b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:41.065287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4d69-26e5-41da-bb66-8fa071d0175b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:41.066535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814d4d69-26e5-41da-bb66-8fa071d0175b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:41.067594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4d69-26e5-41da-bb66-8fa071d0175b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:41.070854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814d4d69-26e5-41da-bb66-8fa071d0175b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:41.087198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1083/2144] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:41 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:41.093984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:41.105309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d40a096-3c0f-4ba0-92dd-81d1aba379ed admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:41.110708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:41.111007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:41.111287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:41.112320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] PATH_INFO: `/v3/projects/7400288c21b34c5d92e065a4cbed1bab/users/f9569405b89341f99a7df0618112cfe9/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:41.140509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7400288c21b34c5d92e065a4cbed1bab, user_id=f9569405b89341f99a7df0618112cfe9, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:41.146355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:41.173175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=11,keystone:SELECT=85,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:41.182666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1062/2145] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:41 2022] PUT /identity/v3/projects/7400288c21b34c5d92e065a4cbed1bab/users/f9569405b89341f99a7df0618112cfe9/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:41.193084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d61bc-c502-4221-baea-46e159a38a39 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:41.194396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d61bc-c502-4221-baea-46e159a38a39 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:41.194798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47d61bc-c502-4221-baea-46e159a38a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:41.275028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f47d61bc-c502-4221-baea-46e159a38a39 None None] MFA Rules not processed for user `f9569405b89341f99a7df0618112cfe9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:41.276313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f47d61bc-c502-4221-baea-46e159a38a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:41.368624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1084/2146] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:41 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:41.377302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:41.379956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:41.526977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9433423-2a0d-4788-9695-ac9e6a0ac5c3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:41.533807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d6f056-3e99-4e5c-86ab-eb2fd0060eb4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:41.534681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f056-3e99-4e5c-86ab-eb2fd0060eb4 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:41.535344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f056-3e99-4e5c-86ab-eb2fd0060eb4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:41.535906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d6f056-3e99-4e5c-86ab-eb2fd0060eb4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:41.560537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6f056-3e99-4e5c-86ab-eb2fd0060eb4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:41.562043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d6f056-3e99-4e5c-86ab-eb2fd0060eb4 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:41.579225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1063/2147] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:41 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 202 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:42.275955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4e5e-5a27-4627-b107-5b1f8d0454f9 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:42.278997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4e5e-5a27-4627-b107-5b1f8d0454f9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:42.279663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3d4e5e-5a27-4627-b107-5b1f8d0454f9 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:42.283014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1085/2148] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:01:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:01:42.289864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:42.290201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:42.290658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:42.318179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:42.320253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:42.399740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4e5e-5a27-4627-b107-5b1f8d0454f9 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:42.403158 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea3d4e5e-5a27-4627-b107-5b1f8d0454f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:42.407020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1064/2149] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:01:42 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:42.423464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:42.425025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:42.440550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee31559-3ccf-48b7-b967-f737bcbea0bd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:42.447515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:42.448159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:42.448602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:42.449205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:42.462995 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:42.464636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:42.495941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1065/2150] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:42 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:42.497778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3d4e5e-5a27-4627-b107-5b1f8d0454f9 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:42.504367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:42.505057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:42.505343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:42.505617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] PATH_INFO: `/v3/users/2a0b55bf8f614a948f2cbd684f8faca3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:42.509404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a0b55bf8f614a948f2cbd684f8faca3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:42.512021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:42.601368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a0b55bf8f614a948f2cbd684f8faca3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:42.602032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a0b55bf8f614a948f2cbd684f8faca3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:42.610881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a0b55bf8f614a948f2cbd684f8faca3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:42.620798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a0b55bf8f614a948f2cbd684f8faca3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:42.624020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:42.642556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d0580bb3-3ff3-4b1b-b8aa-04bf3839e5a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a0b55bf8f614a948f2cbd684f8faca3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:42.649911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1086/2151] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:42 2022] DELETE /identity/v3/users/2a0b55bf8f614a948f2cbd684f8faca3 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:42.837938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:42.854072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46816461-3e1f-4cdf-aaaa-e9b522566fd6 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:42.929613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:42.930251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:42.930587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:42.930845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] PATH_INFO: `/v3/projects/c790d9e7de1e4009ae066086d2ee085b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:42.932385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c790d9e7de1e4009ae066086d2ee085b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:42.940731 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.005399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:43.041749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c790d9e7de1e4009ae066086d2ee085b', 'request_id': 'req-36cf87b4-f117-42a2-a8f9-b621caa570d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:43.055594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c790d9e7de1e4009ae066086d2ee085b', 'request_id': 'req-36cf87b4-f117-42a2-a8f9-b621caa570d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:43.066308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c790d9e7de1e4009ae066086d2ee085b', 'request_id': 'req-36cf87b4-f117-42a2-a8f9-b621caa570d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:43.081104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] The token cache is being invalidate because project c790d9e7de1e4009ae066086d2ee085b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:43.081395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:43.082130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-36cf87b4-f117-42a2-a8f9-b621caa570d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:43.083778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1066/2152] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:42 2022] DELETE /identity/v3/projects/c790d9e7de1e4009ae066086d2ee085b => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:43.089975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.090325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.090589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.113500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:43.114892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:43.198539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1087/2153] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:43.210675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.211090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.211523 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.245369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:43.246822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:43.260934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1067/2154] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:43.265899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.276719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e507e9-81cc-41be-9f7f-f7901d6137a8 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.281526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.282140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.282414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.282684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.283337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:43.283703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.285656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.298802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1088/2155] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:43.303380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.314260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490b1aca-ab60-4cae-80e8-46233d2e73ae None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.320440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.321037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.321311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.321577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.322194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.324127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.357321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1068/2156] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:43 2022] POST /identity/v3/projects => generated 377 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:43.361961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.376994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a06f20-1a21-4e35-8331-2d7176d0106d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.449393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.449994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.450273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.450544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.451162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.453126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.475831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1089/2157] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:43 2022] POST /identity/v3/users => generated 289 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:43.480353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.490618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53377435-b66e-4ce8-9d8e-f1bea7e094a1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.495426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.496013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.496326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.496597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.497233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.498803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.509366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1069/2158] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:43.513434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.523950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d924a3fe-206a-42dd-b8e6-8d41c248366c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.528533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c3d69dd-7997-4ad1-8790-b59b2cbaa7fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.529122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d69dd-7997-4ad1-8790-b59b2cbaa7fe admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.529404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d69dd-7997-4ad1-8790-b59b2cbaa7fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.529676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c3d69dd-7997-4ad1-8790-b59b2cbaa7fe admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.530314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d69dd-7997-4ad1-8790-b59b2cbaa7fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.531898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c3d69dd-7997-4ad1-8790-b59b2cbaa7fe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.542624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1090/2159] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:43.546706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.556575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d55687-709a-42d1-8c70-b3f4b1b36385 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.561196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.561829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.562104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.562374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] PATH_INFO: `/v3/projects/4c3108f5ff924fb88002f19e00296d6a/users/31607fccfbaf44c9b0ce1f663a83f8a1/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.577184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3108f5ff924fb88002f19e00296d6a, user_id=31607fccfbaf44c9b0ce1f663a83f8a1, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.579794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.593554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1070/2160] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:43 2022] PUT /identity/v3/projects/4c3108f5ff924fb88002f19e00296d6a/users/31607fccfbaf44c9b0ce1f663a83f8a1/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:43.598507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.598796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.599073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.618192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:43.619392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:43.665550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:43.684200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1091/2161] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:43.693444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:43.695265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:43.761431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422cb10e-06bd-4364-9d9d-4227b07f3598 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:43.765203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a9c64c-9137-420c-b271-0c60ca616547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:43.765879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9c64c-9137-420c-b271-0c60ca616547 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:43.766231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9c64c-9137-420c-b271-0c60ca616547 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:43.766559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a9c64c-9137-420c-b271-0c60ca616547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:43.776560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9c64c-9137-420c-b271-0c60ca616547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:43.777976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a9c64c-9137-420c-b271-0c60ca616547 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:43.787831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1071/2162] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:45.859448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:45.873247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:45.964347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ea5548-42de-4a45-86fa-ab23d74c5c25 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:45.968891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:45.969523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:45.969802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:45.970073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:45.972081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:46.050948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:46.052539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:46.064351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1092/2163] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:45 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:49.351876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:49.352406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:49.352612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:49.385863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] MFA Rules not processed for user `31607fccfbaf44c9b0ce1f663a83f8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:49.387336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:49.447787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:49.483561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1072/2164] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:49 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:49.497975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:49.499401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:49.587820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c99b8d3-d576-47e6-a9de-d13a003ff6c0 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:49.593708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:49.594410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:49.594765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:49.595109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:49.604592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:49.606329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:49.624256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1093/2165] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:49 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:50.277210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:50.278790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:50.297233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0aa725-9c03-496a-b9e7-960177db9667 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:50.307899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:50.310713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:50.311035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:50.311422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] PATH_INFO: `/v3/users/2c47100284f94d4496c0b98ceca0c827` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:50.313028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2c47100284f94d4496c0b98ceca0c827)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:50.315435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:50.353526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:50.358393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:50.389985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de2668b-2862-4c91-a0e3-044e57dbe72e service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:50.398060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2c47100284f94d4496c0b98ceca0c827'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.399333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2c47100284f94d4496c0b98ceca0c827'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.407982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:50.410292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:50.410741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:50.411165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] PATH_INFO: `/v3/users/f9569405b89341f99a7df0618112cfe9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:50.414318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9569405b89341f99a7df0618112cfe9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:50.417168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:50.426329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2c47100284f94d4496c0b98ceca0c827'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.461635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2c47100284f94d4496c0b98ceca0c827'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.474860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b38f8550-25cb-47ab-9bd2-0c72fb2878f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2c47100284f94d4496c0b98ceca0c827'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.489691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1073/2166] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:50 2022] DELETE /identity/v3/users/2c47100284f94d4496c0b98ceca0c827 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:50.493745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:50.494388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:50.495051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:50.539180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:50.584387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9569405b89341f99a7df0618112cfe9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.585333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9569405b89341f99a7df0618112cfe9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.594832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9569405b89341f99a7df0618112cfe9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.605650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9569405b89341f99a7df0618112cfe9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.621082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-191b3ad3-0355-473e-9a1c-3e621a66037b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9569405b89341f99a7df0618112cfe9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:50.629834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1094/2167] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:50 2022] DELETE /identity/v3/users/f9569405b89341f99a7df0618112cfe9 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:50.635349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:50.635951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:50.636148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:50.636638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:50.637225 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:50.673711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:50.675220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:50.776517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1074/2168] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:50.781645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:50.783519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:50.796121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1095/2169] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:50.811588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:50.813372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:50.871041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8036a592-62ec-4236-badb-6ea9f5c467a9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:50.875700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:50.876640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:50.877213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:50.877690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:50.890137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:50.892160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:50.902082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:50.913515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1075/2170] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:50.925550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a576d6c0-d933-487f-b260-8831558150b2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:50.932746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:50.933526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:50.933908 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:50.934286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:50.945608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:50.947504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:50.960019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1096/2171] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:51.441728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:51.445038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:51.477326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2081bc2-7ef0-413e-b502-750d84b55177 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:51.494882 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:51.495829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:51.498439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:51.498668 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] PATH_INFO: `/v3/projects/6f57745a62ff4420a19beafe007ed900` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:51.502263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=6f57745a62ff4420a19beafe007ed900)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:51.507090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:51.575794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6f57745a62ff4420a19beafe007ed900', 'request_id': 'req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.584541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6f57745a62ff4420a19beafe007ed900', 'request_id': 'req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.593450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6f57745a62ff4420a19beafe007ed900', 'request_id': 'req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.613980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] The token cache is being invalidate because project 6f57745a62ff4420a19beafe007ed900 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:51.614623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.616710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.619946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1076/2172] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:51 2022] DELETE /identity/v3/projects/6f57745a62ff4420a19beafe007ed900 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:51.629491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:51.655273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55b5bc0-047a-4990-80a9-a89998043872 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:51.744749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:51.746993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:51.748475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:51.792059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:51.793823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:51.794140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:51.795564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] PATH_INFO: `/v3/users/9f7568696b59417383d17cd275e3b46f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:51.801092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7568696b59417383d17cd275e3b46f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:51.803071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:51.904609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c57c6c3-6c6c-49d2-b339-ee623e0f10ba admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:51.907337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7568696b59417383d17cd275e3b46f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.908600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7568696b59417383d17cd275e3b46f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.918261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:51.919077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:51.919242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:51.919740 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] PATH_INFO: `/v3/projects/7400288c21b34c5d92e065a4cbed1bab` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:51.921878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=7400288c21b34c5d92e065a4cbed1bab)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:51.924824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:51.932148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7568696b59417383d17cd275e3b46f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.941732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7568696b59417383d17cd275e3b46f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.972606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ae837f18-5d5f-4eb4-bdc5-2af541aa0f1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7568696b59417383d17cd275e3b46f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:51.989634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1097/2173] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:51 2022] DELETE /identity/v3/users/9f7568696b59417383d17cd275e3b46f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:52.046618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7400288c21b34c5d92e065a4cbed1bab', 'request_id': 'req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.054409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7400288c21b34c5d92e065a4cbed1bab', 'request_id': 'req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.064545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7400288c21b34c5d92e065a4cbed1bab', 'request_id': 'req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.097458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615e55-b544-4806-9659-18c2004277df None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.097722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615e55-b544-4806-9659-18c2004277df None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.098021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47615e55-b544-4806-9659-18c2004277df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.110458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] The token cache is being invalidate because project 7400288c21b34c5d92e065a4cbed1bab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:52.113898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.131855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-47615e55-b544-4806-9659-18c2004277df None None] MFA Rules not processed for user `31607fccfbaf44c9b0ce1f663a83f8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:52.134233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1dd5f07f-70c0-482f-8c59-1e03a14e23fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.136502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-47615e55-b544-4806-9659-18c2004277df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:52.142413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1077/2174] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:51 2022] DELETE /identity/v3/projects/7400288c21b34c5d92e065a4cbed1bab => generated 0 bytes in 399 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:52.148438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.149569 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.152154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.205437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:52.211286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:52.235681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:52.335962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1098/2175] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:52.367950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1078/2176] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:52.376196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.376796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.377366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.487447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:52.494452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:52.527104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1099/2177] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:52.528370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:52.543375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f904df8-cf9f-400b-941e-56436fc84bda None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:52.561021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:52.561423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.562568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.564013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.570780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:52.571237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:52.572982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:52.602447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1079/2178] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:52.603854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:52.617259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78833b-09ac-4ff4-9af7-31263dca66de None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:52.624891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:52.626636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:52.633875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:52.635951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.636340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.636682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.640106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:52.642310 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:52.653769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209fdb5b-2428-4bf0-89f1-6b8f55254e44 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:52.670665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:52.671314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.671609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.671888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] PATH_INFO: `/v3/projects/38a3855294324a32a6a29cf691be91b2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.673307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] RBAC: Authorizing `identity:delete_project(project_id=38a3855294324a32a6a29cf691be91b2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:52.680288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:52.709670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1100/2179] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:52.713045 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:52.790799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '38a3855294324a32a6a29cf691be91b2', 'request_id': 'req-b58e3452-7b72-4908-83dd-6c2b441d2c6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.797761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '38a3855294324a32a6a29cf691be91b2', 'request_id': 'req-b58e3452-7b72-4908-83dd-6c2b441d2c6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.806664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '38a3855294324a32a6a29cf691be91b2', 'request_id': 'req-b58e3452-7b72-4908-83dd-6c2b441d2c6d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.811338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:52.835584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] The token cache is being invalidate because project 38a3855294324a32a6a29cf691be91b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:52.835841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.836962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b58e3452-7b72-4908-83dd-6c2b441d2c6d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:52.843064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1080/2180] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:52 2022] DELETE /identity/v3/projects/38a3855294324a32a6a29cf691be91b2 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:52.845059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729a5a-fa8f-4b59-a005-45c050d48259 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.845621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729a5a-fa8f-4b59-a005-45c050d48259 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.846053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab729a5a-fa8f-4b59-a005-45c050d48259 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.864110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42fb9eda-92e1-40c1-95e9-4de65063225e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:52.871777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ab729a5a-fa8f-4b59-a005-45c050d48259 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:52.873503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ab729a5a-fa8f-4b59-a005-45c050d48259 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:52.957277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:52.958107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.965854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.966187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:52.968241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:52.972021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:52.977294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1081/2181] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:52.986677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:52.987183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:52.988160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.020066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1101/2182] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/users => generated 293 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:53.025966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:53.027802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.028113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:53.033261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:53.044812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1082/2183] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:53.045122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.052258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09578c93-7c7c-4745-8b17-a136666ddd00 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.056721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64d57ac-1866-4e93-ba03-76467a2e0d66 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.058384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.059118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.059492 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.059859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.060661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.062368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.062706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.062979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.063238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.063516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.064730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:53.065038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.066698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.074572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1102/2184] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:53.079029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.097088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1083/2185] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:53.105144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.106875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e22f83-f872-4eb6-9553-2fe8e9c4ed3d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.115686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.116974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.117583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.118157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.118891 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.119368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:53.120549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.129511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3613cf8-3e37-47c7-941a-67ede1ef55df admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.136773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.138498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.139168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.139801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.140592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.143179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.159416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1103/2186] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:53.171388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.206118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7899bbbe-a007-4fc8-b981-648014eb1f27 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.217988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadc6fb7-5709-43b2-add3-efec8ff52293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.217988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc6fb7-5709-43b2-add3-efec8ff52293 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.217988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc6fb7-5709-43b2-add3-efec8ff52293 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.217988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadc6fb7-5709-43b2-add3-efec8ff52293 admin admin] PATH_INFO: `/v3/projects/7a4a735e5f90417bae1e490b63d15344/users/3295c8fdfee74368824d74c060841c60/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.227250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1084/2187] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:53 2022] POST /identity/v3/projects => generated 367 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:53.229793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.257687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc6fb7-5709-43b2-add3-efec8ff52293 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a4a735e5f90417bae1e490b63d15344, user_id=3295c8fdfee74368824d74c060841c60, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.263701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadc6fb7-5709-43b2-add3-efec8ff52293 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.292092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1104/2188] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:53 2022] PUT /identity/v3/projects/7a4a735e5f90417bae1e490b63d15344/users/3295c8fdfee74368824d74c060841c60/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:53.296019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.296882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.296882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.321266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2e488f-4c0b-4232-a55d-f05b70a77e5b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.329146 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] MFA Rules not processed for user `3295c8fdfee74368824d74c060841c60`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:53.330340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:53.410009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.410622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.411075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.411231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.416957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.424787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.454078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1105/2189] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:53 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:53.455943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.457137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1085/2190] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:53 2022] POST /identity/v3/users => generated 284 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:53.464147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.469967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a294928f-d156-474c-a644-cb6a9682e024 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.475910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.476288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df06d4f7-f763-4d4e-bfad-cbc282e659ab admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.476859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.477139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.477539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.478165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.481134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.481709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.493370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.493680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.493965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.495821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.498044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.502450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:53.525895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1086/2191] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:53.527621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.530212 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1106/2192] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:53 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:53.534726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.541986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0993b9-3b46-4a94-9952-8f8dfc1e1e11 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.628717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.629483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.629831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.630214 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.631064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.632799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.670125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1087/2193] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:53.670827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.672524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3595fb-299d-467d-bc4e-b48d01b51a09 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.681982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.682747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:53.683379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.683806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.684502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.687702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.691949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.698097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:53.702147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2cfc4d-0c49-43a5-b271-1d1a740b9381 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.707371 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.708017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.709735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.710111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] PATH_INFO: `/v3/users/6819f88e125545c1a273b1aef0d6609e` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.712664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6819f88e125545c1a273b1aef0d6609e)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.721294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.727694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1107/2194] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:53 2022] POST /identity/v3/users => generated 292 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:53.728552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.741660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dadeb4-0884-4bf4-94f7-de01e9fec618 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:53.748006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:53.749149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.749724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.750419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] PATH_INFO: `/v3/projects/81c00d0d0a5649359985e0d55741aa83/users/526fc0562fb64d449730750c4c81de4f/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.825143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=81c00d0d0a5649359985e0d55741aa83, user_id=526fc0562fb64d449730750c4c81de4f, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:53.826450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6819f88e125545c1a273b1aef0d6609e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:53.827361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6819f88e125545c1a273b1aef0d6609e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:53.828494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:53.854484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1108/2195] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:53 2022] PUT /identity/v3/projects/81c00d0d0a5649359985e0d55741aa83/users/526fc0562fb64d449730750c4c81de4f/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:53.865996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:53.875770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6819f88e125545c1a273b1aef0d6609e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:53.900633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6819f88e125545c1a273b1aef0d6609e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:53.928576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-e32bec63-32f5-4433-a5ac-a993bdc170c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6819f88e125545c1a273b1aef0d6609e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:53.963098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1088/2196] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:53 2022] DELETE /identity/v3/users/6819f88e125545c1a273b1aef0d6609e => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:53.963098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:53.963098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:53.963098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:53.994472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6209be7-ee83-4e95-abf3-d5632cbfbf1d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.013449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] MFA Rules not processed for user `526fc0562fb64d449730750c4c81de4f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:54.014702 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:54.077468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd998508-6dde-4bfd-90bc-aeb12b0551f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.078671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998508-6dde-4bfd-90bc-aeb12b0551f2 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.079114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998508-6dde-4bfd-90bc-aeb12b0551f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.079439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd998508-6dde-4bfd-90bc-aeb12b0551f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.080233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd998508-6dde-4bfd-90bc-aeb12b0551f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.085449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd998508-6dde-4bfd-90bc-aeb12b0551f2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.112434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1109/2197] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:53 2022] GET /identity/v3/roles => generated 1420 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:54.112434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3350-7896-4187-9f31-587557757846 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.112434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3350-7896-4187-9f31-587557757846 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.112434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fa3350-7896-4187-9f31-587557757846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.112936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1089/2198] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:54.112936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.113605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:54.115002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:54.130690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-62fa3350-7896-4187-9f31-587557757846 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:54.132593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62fa3350-7896-4187-9f31-587557757846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:54.133130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ee2e51-f921-41a3-b70e-f26d1f558a4e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.139511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.140438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.140438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.140732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.141363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.142481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1110/2199] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:54.143125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.143460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3350-7896-4187-9f31-587557757846 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.145113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-62fa3350-7896-4187-9f31-587557757846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:54.156589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1090/2200] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:54.160487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.163158 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fa3350-7896-4187-9f31-587557757846 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.170470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e321cc2-0fdf-4ff8-8974-810940e157d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.171552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321cc2-0fdf-4ff8-8974-810940e157d5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.171930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321cc2-0fdf-4ff8-8974-810940e157d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.172527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e321cc2-0fdf-4ff8-8974-810940e157d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.173268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321cc2-0fdf-4ff8-8974-810940e157d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.173659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077f83ce-b560-4bd3-8c1d-fdf6bedde2c7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.176098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e321cc2-0fdf-4ff8-8974-810940e157d5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.179400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.180088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.180379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.180658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] PATH_INFO: `/v3/projects/b8dce5e2d75844988d64d5ab8f7fffc9/users/932c5086bc694e53a181b49814ebf971/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.199470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b8dce5e2d75844988d64d5ab8f7fffc9, user_id=932c5086bc694e53a181b49814ebf971, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.202527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.222551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1091/2201] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:54 2022] PUT /identity/v3/projects/b8dce5e2d75844988d64d5ab8f7fffc9/users/932c5086bc694e53a181b49814ebf971/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:54.228298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.228298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:54.261446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1111/2202] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:54 2022] POST /identity/v3/projects => generated 367 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:54.262841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.263226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.263601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.270328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:54.306865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c152e4d-068c-4d5c-a241-1202afe3aa76 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.319388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] MFA Rules not processed for user `932c5086bc694e53a181b49814ebf971`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:54.321551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:54.379707 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.380326 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.381204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.381491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.448216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1112/2203] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:54.448995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.465016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.466537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.499542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1092/2204] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:54.499920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.527662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-815b7b50-d6a3-48fe-983d-03afab8365f1 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.538777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.539716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.540181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.540564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.541302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.543643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.613390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1093/2205] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:54 2022] POST /identity/v3/projects => generated 381 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:54.618780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.626905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b5c6cd-54e7-44f5-9e0e-a254d5092c27 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.713417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.715485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.715950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.716985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.717869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.720766 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.741839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:54.742683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dacf3a-2d28-4c54-9f7a-1aab4f3eb84d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.751130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1113/2206] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:54 2022] POST /identity/v3/users => generated 290 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:54.755302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.755677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.758041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.758531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.758963 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.761538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.764035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.768939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70ff68-fec0-48c2-bfc5-bd643797e043 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.787622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.795725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.797015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.797447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.799233 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.807923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.810913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1094/2207] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:54 2022] POST /identity/v3/users => generated 297 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:54.814814 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.826790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1114/2208] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:54.829663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:54.832301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.844357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f3beef-4dc3-4a2f-a66c-be92c462a1c5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.845651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd2cfbe9-db6b-4c5e-a7f2-69b918aadd99 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.855621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.857256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.858016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.858499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.859264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.859646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.860479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.860861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.861443 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] PATH_INFO: `/v3/projects/e26432565829490e9368acd9a2875a4e/users/9f2f8677cbfb4b01bd62f86b87dd7d71/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.865962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.894346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1095/2209] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:54.900587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.903026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26432565829490e9368acd9a2875a4e, user_id=9f2f8677cbfb4b01bd62f86b87dd7d71, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.909787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:54.915106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ef3e4b-9185-4a15-9eaf-13e797d15a89 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:54.922827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:54.923490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:54.923831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:54.924036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] PATH_INFO: `/v3/projects/03d9d147cf23460ca44ada5da58af755/users/aea8b11857594a7298376e9c6bfbcefc/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:54.942050 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1115/2210] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:54 2022] PUT /identity/v3/projects/e26432565829490e9368acd9a2875a4e/users/9f2f8677cbfb4b01bd62f86b87dd7d71/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:54.948452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:54.958141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d9d147cf23460ca44ada5da58af755, user_id=aea8b11857594a7298376e9c6bfbcefc, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:54.962159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.014972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1096/2211] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:54 2022] PUT /identity/v3/projects/03d9d147cf23460ca44ada5da58af755/users/aea8b11857594a7298376e9c6bfbcefc/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:55.024093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.094202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73ded3-6463-4e40-ac48-f8e9b6f788a4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.132998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c84bff-828b-4777-84a8-3ea39f6d144d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.139514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.140355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.140755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.141120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.142457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.143559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.163578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1097/2212] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:55.164446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.166922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.202817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2211021-d3be-4317-ac7e-82f7271f6492 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.217194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.218428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.219453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.220337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] PATH_INFO: `/v3/projects/74070616859f43519d24f4e8bd7c28bd` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.221632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] RBAC: Authorizing `identity:delete_project(project_id=74070616859f43519d24f4e8bd7c28bd)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.223934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.241153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.241801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.242084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.242362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.243251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.245004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.259730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1116/2213] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:55.260530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.278791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36449b3b-c8c4-4659-9be3-edd74d0341b6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.289387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.290211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.290627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.290915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] PATH_INFO: `/v3/projects/03d9d147cf23460ca44ada5da58af755/users/aea8b11857594a7298376e9c6bfbcefc/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.294155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03d9d147cf23460ca44ada5da58af755, user_id=aea8b11857594a7298376e9c6bfbcefc, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.298291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.309991 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '74070616859f43519d24f4e8bd7c28bd', 'request_id': 'req-40106085-8578-464f-9fb7-d1be6166042c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:55.321844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '74070616859f43519d24f4e8bd7c28bd', 'request_id': 'req-40106085-8578-464f-9fb7-d1be6166042c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:55.331095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1117/2214] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:55 2022] PUT /identity/v3/projects/03d9d147cf23460ca44ada5da58af755/users/aea8b11857594a7298376e9c6bfbcefc/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:55.332432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.340685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '74070616859f43519d24f4e8bd7c28bd', 'request_id': 'req-40106085-8578-464f-9fb7-d1be6166042c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:55.369464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] The token cache is being invalidate because project 74070616859f43519d24f4e8bd7c28bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:55.369855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:55.373404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-40106085-8578-464f-9fb7-d1be6166042c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:55.374538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1098/2215] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:55 2022] DELETE /identity/v3/projects/74070616859f43519d24f4e8bd7c28bd => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:55.375774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885e86e-4a1a-465a-9eb9-4c25ffcf56cc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.376073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885e86e-4a1a-465a-9eb9-4c25ffcf56cc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.376374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0885e86e-4a1a-465a-9eb9-4c25ffcf56cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.430970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0885e86e-4a1a-465a-9eb9-4c25ffcf56cc None None] MFA Rules not processed for user `aea8b11857594a7298376e9c6bfbcefc`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:55.432223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0885e86e-4a1a-465a-9eb9-4c25ffcf56cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.448804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:55.455755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6ab1d3-2e47-4dd9-a82e-39b6d229fcd9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.465941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d977f4c-edfc-4ea5-bea4-b38883167e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.467720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977f4c-edfc-4ea5-bea4-b38883167e9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.468415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977f4c-edfc-4ea5-bea4-b38883167e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.468703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d977f4c-edfc-4ea5-bea4-b38883167e9d admin admin] PATH_INFO: `/v3/projects/e26432565829490e9368acd9a2875a4e/users/9f2f8677cbfb4b01bd62f86b87dd7d71/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.471294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977f4c-edfc-4ea5-bea4-b38883167e9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e26432565829490e9368acd9a2875a4e, user_id=9f2f8677cbfb4b01bd62f86b87dd7d71, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.490400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d977f4c-edfc-4ea5-bea4-b38883167e9d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.516099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1118/2216] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:55 2022] PUT /identity/v3/projects/e26432565829490e9368acd9a2875a4e/users/9f2f8677cbfb4b01bd62f86b87dd7d71/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:55.517717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.518196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.518482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.549084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:55.550230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:55.551742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.622909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1099/2217] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 248 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:55.624332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9131a5-e552-4508-a515-7f6b05347ec3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.624673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9131a5-e552-4508-a515-7f6b05347ec3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.625021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9131a5-e552-4508-a515-7f6b05347ec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.660888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a9131a5-e552-4508-a515-7f6b05347ec3 None None] MFA Rules not processed for user `9f2f8677cbfb4b01bd62f86b87dd7d71`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:55.662577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a9131a5-e552-4508-a515-7f6b05347ec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.673947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1119/2218] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:55.675194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.676704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.745880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1100/2219] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:55.747042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.747336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.747614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.748379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dbf857-6292-44d8-901f-9cba47028c8e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.757086 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.757921 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.758359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.759070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.761308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.772920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:55.774250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.783676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1101/2220] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:55.788855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.791179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.820265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe807ae0-9036-4f8b-9280-ac314b5e62a7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.824981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.825733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.826019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.826293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.828772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.830413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.837171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.838806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.844197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1120/2221] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:55 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:55.846950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.861969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1102/2222] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:55 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:55.864601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e064601-0223-4e03-abaf-5909eddf5034 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.873178 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.873881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.874234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.874579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.875308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:55.876075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.877947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.894703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1121/2223] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:55.899936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.919103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015fd524-d535-45bf-8806-2a4c6f76b6d7 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.933971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.935233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.935694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.936151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.936954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:55.939037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:55.952453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:55.965320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a490204-7c2d-4cdc-8dd6-58238b9f3bb3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:55.974899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:55.976008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:55.976499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:55.977207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:55.980380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:55.986770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1103/2224] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:55 2022] POST /identity/v3/projects => generated 385 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:55.994120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:56.041748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:56.088284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.090953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.101935 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40474045-ebbe-4850-a4b0-e91e7049235e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:56.105051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1122/2225] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:55 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:56.107610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:56.108385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.108905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.109282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.110143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.112195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.144306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1104/2226] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:55 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:56.145133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:56.158824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6039a1-2876-4df6-9e10-7cbff6742883 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:56.166571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:56.167417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.167860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.168243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.169879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.172237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.188302 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1123/2227] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:56.191795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:56.204765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a594b24-4ba3-4ddc-a472-50d258713c61 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:56.214376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3042e42e-1522-46a9-a28b-3b509dfc3e32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:56.215497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e42e-1522-46a9-a28b-3b509dfc3e32 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.216662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e42e-1522-46a9-a28b-3b509dfc3e32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.217148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3042e42e-1522-46a9-a28b-3b509dfc3e32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.218205 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042e42e-1522-46a9-a28b-3b509dfc3e32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.220714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3042e42e-1522-46a9-a28b-3b509dfc3e32 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.223513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:56.265351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1105/2228] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:56.265588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:56.280303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f240f09-7014-4c30-a32b-668fcb2a3025 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:56.296529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:56.303490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.304011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.304946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] PATH_INFO: `/v3/projects/523508b00e5f4544a0dbc6c8ad031602/users/213b3d0bd2714b13b344a16992196409/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.345190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=523508b00e5f4544a0dbc6c8ad031602, user_id=213b3d0bd2714b13b344a16992196409, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.348363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.371405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1124/2229] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:56 2022] PUT /identity/v3/projects/523508b00e5f4544a0dbc6c8ad031602/users/213b3d0bd2714b13b344a16992196409/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:56.377154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.378922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.378922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.408330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:56.410522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:56.550328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1106/2230] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:56.563518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:56.566226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:56.689581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:56.693880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:56.718698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e180ed-d327-4f48-aeeb-4f3c98b04964 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:56.727722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:56.728580 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.728865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.730267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] PATH_INFO: `/v3/users/048aa94dc02744df829735c63eb89b89` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.731483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] RBAC: Authorizing `identity:delete_user(user_id=048aa94dc02744df829735c63eb89b89)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.733488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.757995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e64bb5d-6cb2-4817-8258-45bb293dddf7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:56.764240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ddb76-9208-4a03-87bf-3e1df823b431 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:56.764885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ddb76-9208-4a03-87bf-3e1df823b431 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.765119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ddb76-9208-4a03-87bf-3e1df823b431 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.765994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ddb76-9208-4a03-87bf-3e1df823b431 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.780150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ddb76-9208-4a03-87bf-3e1df823b431 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:56.783654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ddb76-9208-4a03-87bf-3e1df823b431 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:56.824256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1125/2231] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:56.841328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '048aa94dc02744df829735c63eb89b89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:56.843116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '048aa94dc02744df829735c63eb89b89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:56.875679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '048aa94dc02744df829735c63eb89b89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:56.901034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '048aa94dc02744df829735c63eb89b89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:56.913367 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '048aa94dc02744df829735c63eb89b89'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:56.925744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1107/2232] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:01:56 2022] DELETE /identity/v3/users/048aa94dc02744df829735c63eb89b89 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:01:56.928030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:56.928342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:56.928628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:56.967048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:56.969105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:57.074565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1126/2233] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:57.087063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:57.088744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:57.168456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7616b1-bfec-444d-8dc1-d119dfa2863c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:57.174394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:57.175101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:57.175410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:57.175703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:57.186826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:57.188625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:57.201773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1108/2234] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:57.590837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:57.592544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:57.682110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:57.716295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8fed98-b819-4534-93c5-d4433a1ecda4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:57.717570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:57.720224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:57.720667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:57.722156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:57.727031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:57.827528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:57.829690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5a1584-c363-4030-bb72-a4820cf80a06 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:57.850656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1127/2235] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:01:58.491653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:58.495028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:58.521098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f364ec-744f-4e56-8d9b-fd0627512c4a service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:58.527770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:58.528821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:58.529313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:58.529817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] PATH_INFO: `/v3/projects/989ebd4aafc14e61a7c3ac10b2348623` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:58.531187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=989ebd4aafc14e61a7c3ac10b2348623)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:58.533349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:58.542343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:58.680406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '989ebd4aafc14e61a7c3ac10b2348623', 'request_id': 'req-3badbb77-a27a-4629-a4ad-4fe87168c230'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:58.700142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '989ebd4aafc14e61a7c3ac10b2348623', 'request_id': 'req-3badbb77-a27a-4629-a4ad-4fe87168c230'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:58.707917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '989ebd4aafc14e61a7c3ac10b2348623', 'request_id': 'req-3badbb77-a27a-4629-a4ad-4fe87168c230'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:58.727220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] The token cache is being invalidate because project 989ebd4aafc14e61a7c3ac10b2348623 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:01:58.727361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:58.728460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3badbb77-a27a-4629-a4ad-4fe87168c230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:01:58.730248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1109/2236] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:01:58 2022] DELETE /identity/v3/projects/989ebd4aafc14e61a7c3ac10b2348623 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:58.735608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:58.735741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:58.735949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:58.763103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:58.764407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:58.870491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1128/2237] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:58.871644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:58.872152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:58.872632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:58.921561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:58.925122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:58.959048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:58.970095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0521914d-47e2-4d2c-b757-e9a82f68fdfc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:58.972193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1110/2238] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:01:58.983554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:58.984222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:58.984503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:58.984776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:58.985446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:01:58.985747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:58.992378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.022365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1129/2239] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:01:59.026647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.038477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d68a81f-2221-4951-a0ff-47f022fb9862 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.053211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.054598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.054598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.054598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.055364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.057737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.071368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.073173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:59.145490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1111/2240] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:01:59 2022] POST /identity/v3/projects => generated 373 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:01:59.147140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.188070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f08161-014f-4304-bc30-cd31132c30c7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.249672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:59.279585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56308f9-5732-4632-aeee-1323956305b5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.284626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.285238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.285514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.285785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.286408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.289271 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.289464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.290017 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.290496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.290839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.293121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:59.317729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1112/2241] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:01:59 2022] POST /identity/v3/users => generated 287 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:01:59.322465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.335776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9937c559-68f8-4633-b734-75d66cffe671 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.343095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.343716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.343996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.344375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.345023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.346622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.361337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1113/2242] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:01:59.365082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.377199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c08307a-6e7a-47a4-8a93-30b9acf46ea2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.383464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.384535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.384965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.385378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.386343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.388754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.400861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.403041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a565fc26-ee0b-4648-9637-42068539427c service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.447386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1130/2243] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:59 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:01:59.451717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1114/2244] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:01:59.452962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.466890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-180e89df-cba8-472b-a70b-1b14e34e9d26 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.472119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.473500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.473500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.473500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] PATH_INFO: `/v3/projects/d0e1a635f2b443b8843106d1c449da9b/users/ab215223f5304b7ea659ac62416e50c9/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.492378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e1a635f2b443b8843106d1c449da9b, user_id=ab215223f5304b7ea659ac62416e50c9, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.495897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.525729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1115/2245] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:01:59 2022] PUT /identity/v3/projects/d0e1a635f2b443b8843106d1c449da9b/users/ab215223f5304b7ea659ac62416e50c9/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:01:59.538572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.539240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.539539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.582770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] MFA Rules not processed for user `ab215223f5304b7ea659ac62416e50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:01:59.584386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:59.716459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1131/2246] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:01:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:01:59.726944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:01:59.729130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:01:59.748409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=7,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:01:59.851227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b5806-008d-4361-995e-1239e8982d8c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:01:59.855100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd447216-ce35-4a07-8b43-150510fd4789 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:01:59.856077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd447216-ce35-4a07-8b43-150510fd4789 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:01:59.856362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd447216-ce35-4a07-8b43-150510fd4789 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:01:59.856691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd447216-ce35-4a07-8b43-150510fd4789 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:01:59.867790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd447216-ce35-4a07-8b43-150510fd4789 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:01:59.869568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd447216-ce35-4a07-8b43-150510fd4789 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:01:59.880836 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1116/2247] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:01:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:00.894114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:00.895577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:01.037850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96baa422-c40a-4513-8fc5-4f552b5938cb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:01.044350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:01.045195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:01.045669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:01.046084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] PATH_INFO: `/v3/users/526fc0562fb64d449730750c4c81de4f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:01.053545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] RBAC: Authorizing `identity:delete_user(user_id=526fc0562fb64d449730750c4c81de4f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:01.055611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:01.093029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:01.176738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '526fc0562fb64d449730750c4c81de4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:01.179282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '526fc0562fb64d449730750c4c81de4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:01.200487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '526fc0562fb64d449730750c4c81de4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:01.212367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '526fc0562fb64d449730750c4c81de4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:01.231176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '526fc0562fb64d449730750c4c81de4f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:01.243647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1132/2248] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:00 2022] DELETE /identity/v3/users/526fc0562fb64d449730750c4c81de4f => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:01.248642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6427e-7d14-48ff-9d76-15c33f5e6c08 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:01.248642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6427e-7d14-48ff-9d76-15c33f5e6c08 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:01.249237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a6427e-7d14-48ff-9d76-15c33f5e6c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:01.296081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c0a6427e-7d14-48ff-9d76-15c33f5e6c08 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:01.304993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c0a6427e-7d14-48ff-9d76-15c33f5e6c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:01.400144 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1117/2249] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:01.411142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:01.415742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:01.528912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cb7585-a279-4719-97ba-ae0669c44702 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:01.533455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:01.534285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:01.534949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:01.535231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:01.546984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:01.548535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:01.557237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:01.557237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:01.557237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:01.563592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1133/2250] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:01.579357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] MFA Rules not processed for user `ab215223f5304b7ea659ac62416e50c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:01.580867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:01.655206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1118/2251] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:03.071424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:03.072950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:03.112927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc595c2-191d-4f6c-a9c5-c215c768389f service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:03.126827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:03.128162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:03.128672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:03.129147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] PATH_INFO: `/v3/projects/81c00d0d0a5649359985e0d55741aa83` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:03.131772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] RBAC: Authorizing `identity:delete_project(project_id=81c00d0d0a5649359985e0d55741aa83)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:03.134383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:03.266425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81c00d0d0a5649359985e0d55741aa83', 'request_id': 'req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.281650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81c00d0d0a5649359985e0d55741aa83', 'request_id': 'req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.305522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81c00d0d0a5649359985e0d55741aa83', 'request_id': 'req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.326927 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] The token cache is being invalidate because project 81c00d0d0a5649359985e0d55741aa83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:03.327218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.328033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.329744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1134/2252] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:03 2022] DELETE /identity/v3/projects/81c00d0d0a5649359985e0d55741aa83 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:03.334396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:03.366399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9636373e-60bb-4c78-886d-27e24df67387 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:03.461765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:03.476816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:03.477712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:03.478137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:03.480153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] PATH_INFO: `/v3/users/9f2f8677cbfb4b01bd62f86b87dd7d71` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:03.481879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f2f8677cbfb4b01bd62f86b87dd7d71)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:03.485501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:03.605631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f2f8677cbfb4b01bd62f86b87dd7d71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.606366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f2f8677cbfb4b01bd62f86b87dd7d71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.635270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f2f8677cbfb4b01bd62f86b87dd7d71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.649274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f2f8677cbfb4b01bd62f86b87dd7d71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.661030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-16aa2872-f29e-489d-bbca-db9efa3bccb9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f2f8677cbfb4b01bd62f86b87dd7d71'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:03.674584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1119/2253] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:03 2022] DELETE /identity/v3/users/9f2f8677cbfb4b01bd62f86b87dd7d71 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:03.942245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:03.945152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:03.980646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4376cb78-8b72-4d7c-85b1-b6befa3c6afd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.012014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:04.112152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.112749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.113203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.113629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] PATH_INFO: `/v3/users/3295c8fdfee74368824d74c060841c60` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.116062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] RBAC: Authorizing `identity:delete_user(user_id=3295c8fdfee74368824d74c060841c60)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.122864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.242082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3295c8fdfee74368824d74c060841c60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:04.243022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3295c8fdfee74368824d74c060841c60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:04.253833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3295c8fdfee74368824d74c060841c60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:04.266145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3295c8fdfee74368824d74c060841c60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:04.280812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f16dccb9-08fc-4a52-a0e3-1fdbea537f5e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3295c8fdfee74368824d74c060841c60'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:04.303489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1135/2254] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:03 2022] DELETE /identity/v3/users/3295c8fdfee74368824d74c060841c60 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:04.312658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.312955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.313233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.333469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.334278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.334667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.350530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:04.353909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.398672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] MFA Rules not processed for user `213b3d0bd2714b13b344a16992196409`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:04.400296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.448128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1120/2255] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:04.456883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.458816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.524057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1136/2256] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:04.531907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.537130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.559623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8483a7-2abc-4a9f-a524-17c0097f2235 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.562333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94c848dd-ce83-4ade-abcf-7ee30dfa3ba1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.567970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.569200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.569696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.570179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.582079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.585396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.585763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.586031 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.586549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.586829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.587466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.590194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.604524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1121/2257] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:02:04.668482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1137/2258] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:04 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:04.673470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.680860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.686579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:04.689640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661361c9-4563-4b2c-8ba6-f4fa0f55697e service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.728391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:04.761105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:04.873511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.876308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.876532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.879763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.881239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.886565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.887767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11076a3e-72f6-423f-a0dc-5191eb553124 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.899780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.901064 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.901352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.902747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] PATH_INFO: `/v3/projects/e26432565829490e9368acd9a2875a4e` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.905288 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e26432565829490e9368acd9a2875a4e)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.910335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:04.943276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1122/2259] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:04 2022] POST /identity/v3/users => generated 299 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:04.949384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:04.977045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045b8cb5-a4c2-4633-b6aa-b00d3a86287f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:04.988389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:04.989498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:04.990106 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:04.990610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:04.991547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:04.996302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.026729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1123/2260] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:04 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:05.027897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.049619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c61d44f-0a40-455f-b3aa-c9fdf968f1fd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:05.065616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e26432565829490e9368acd9a2875a4e', 'request_id': 'req-4fcce600-52f4-4871-839d-36179e429558'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.074506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e26432565829490e9368acd9a2875a4e', 'request_id': 'req-4fcce600-52f4-4871-839d-36179e429558'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.088497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e26432565829490e9368acd9a2875a4e', 'request_id': 'req-4fcce600-52f4-4871-839d-36179e429558'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.108496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] The token cache is being invalidate because project e26432565829490e9368acd9a2875a4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:05.108794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.110411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4fcce600-52f4-4871-839d-36179e429558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.113961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1138/2261] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:04 2022] DELETE /identity/v3/projects/e26432565829490e9368acd9a2875a4e => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:05.120661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef93771-2c85-4489-bc68-77ec0a4604d0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.121539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef93771-2c85-4489-bc68-77ec0a4604d0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.121712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef93771-2c85-4489-bc68-77ec0a4604d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.155972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0ef93771-2c85-4489-bc68-77ec0a4604d0 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:05.157456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0ef93771-2c85-4489-bc68-77ec0a4604d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:05.204278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:05.205189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.205539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.205928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] PATH_INFO: `/v3/projects/fc04d69da59f4a918f80a912d74e715f/users/c7415b01670942cea4a62d88edfd7222/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.252173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1139/2262] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:05.257476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc04d69da59f4a918f80a912d74e715f, user_id=c7415b01670942cea4a62d88edfd7222, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:05.263481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.263804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.264114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.282742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.315661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1124/2263] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:05 2022] PUT /identity/v3/projects/fc04d69da59f4a918f80a912d74e715f/users/c7415b01670942cea4a62d88edfd7222/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:05.321000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.323483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:05.334044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:05.339198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:05.439189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:05.519216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e53719f-50e4-4391-a9ae-b249744cb257 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:05.537647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:05.538223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1140/2264] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:05.539265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.542681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.544110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.544468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.546999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:05.552143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.558805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30dbe77-2ea1-4440-bb1a-a28cfd6b4c3e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:05.569752 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:05.570690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.571087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.571368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.572128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:05.572449 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:05.574362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.580763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1125/2265] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:05 2022] GET /identity/v3/roles => generated 1420 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:05.582610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.589082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:05.593563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1141/2266] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:05.594673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.609438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b078c29-d87f-4486-a812-0662ebf159a4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:05.617539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:05.618478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.619035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.619421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] PATH_INFO: `/v3/projects/fc04d69da59f4a918f80a912d74e715f/users/c7415b01670942cea4a62d88edfd7222/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.621865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc04d69da59f4a918f80a912d74e715f, user_id=c7415b01670942cea4a62d88edfd7222, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:05.627579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.636753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb4fb-ea17-427b-a55c-a7ff5089e7fd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:05.642868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1142/2267] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:05 2022] PUT /identity/v3/projects/fc04d69da59f4a918f80a912d74e715f/users/c7415b01670942cea4a62d88edfd7222/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:05.643696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.666828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:05.793041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:05.794202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.795410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.795792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] PATH_INFO: `/v3/projects/7a4a735e5f90417bae1e490b63d15344` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.797433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd4227e-3295-48bc-8a87-7bc88834e72d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:05.799301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a4a735e5f90417bae1e490b63d15344)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:05.803645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.804318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:05.805303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:05.805904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:05.806321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:05.807312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:05.809921 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:05.848553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1143/2268] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:05 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:05.853596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.904138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a4a735e5f90417bae1e490b63d15344', 'request_id': 'req-3b01762e-8ad9-476b-b128-92949187b206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.918812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a4a735e5f90417bae1e490b63d15344', 'request_id': 'req-3b01762e-8ad9-476b-b128-92949187b206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.930435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a4a735e5f90417bae1e490b63d15344', 'request_id': 'req-3b01762e-8ad9-476b-b128-92949187b206'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.978086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] The token cache is being invalidate because project 7a4a735e5f90417bae1e490b63d15344 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:05.978779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.982007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:05.984941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1126/2269] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:05 2022] DELETE /identity/v3/projects/7a4a735e5f90417bae1e490b63d15344 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:05.988959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:05.994305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:06.011287 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8b4117-066b-45d7-8a98-e4c0c129b315 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.082111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:06.109123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.109887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.110767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.111038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.111679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.114199 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:06.143709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01762e-8ad9-476b-b128-92949187b206 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.149664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.150317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.150594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.150866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] PATH_INFO: `/v3/users/932c5086bc694e53a181b49814ebf971` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.152579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] RBAC: Authorizing `identity:delete_user(user_id=932c5086bc694e53a181b49814ebf971)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.154525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:06.160274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1144/2270] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:05 2022] POST /identity/v3/users => generated 292 bytes in 307 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:06.161283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:06.165412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:06.198244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92ceb5d-f683-4f18-835d-c18e63db6ccd admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.215631 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.217873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.218172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.220401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.222667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.226870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:06.240102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1145/2271] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:06.244097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:06.267030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae591c3-7b79-4300-b25d-377d5e5a8c9a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.280880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '932c5086bc694e53a181b49814ebf971'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:06.282022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.283101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.283223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '932c5086bc694e53a181b49814ebf971'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:06.283315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.283508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.285502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.288825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:06.294379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:06.314437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '932c5086bc694e53a181b49814ebf971'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:06.335512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1146/2272] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:02:06.336368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:06.337158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '932c5086bc694e53a181b49814ebf971'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:06.352409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2248d42-134b-4482-8563-d562e83a8243 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.357928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8d359870-89fa-4486-8d91-126e79451801 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '932c5086bc694e53a181b49814ebf971'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:06.359507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.360109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.360476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.360823 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] PATH_INFO: `/v3/projects/231868a4f51f448aa7135f1fa7def95c/users/64dd0ba9afed4cd394a56d5dd74a1a67/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.376198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1127/2273] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:05 2022] DELETE /identity/v3/users/932c5086bc694e53a181b49814ebf971 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:06.381434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] RBAC: Authorizing `identity:create_grant(project_id=231868a4f51f448aa7135f1fa7def95c, user_id=64dd0ba9afed4cd394a56d5dd74a1a67, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.386330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:06.416224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1147/2274] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:06 2022] PUT /identity/v3/projects/231868a4f51f448aa7135f1fa7def95c/users/64dd0ba9afed4cd394a56d5dd74a1a67/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:06.422981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.423613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.424634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.474467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] MFA Rules not processed for user `64dd0ba9afed4cd394a56d5dd74a1a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:06.476456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:06.657820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1128/2275] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:06.658872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:06.661049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:06.873313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f60b40c-5800-4e9a-8470-769d26366570 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:06.894189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:06.897059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:06.897386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:06.897614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:06.899509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:06.908088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.022969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1148/2276] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:06 2022] POST /identity/v3/projects => generated 383 bytes in 365 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:02:07.027531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.058181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca367728-f17c-4d41-beb1-2399f9375752 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.072910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.074811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:07.182515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.183659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.183943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.184320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.185313 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.188362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.234863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2da2fd4-7b27-4fcb-b089-61a5048d24fa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.235888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1129/2277] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:07 2022] POST /identity/v3/users => generated 298 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:07.238648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.252495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.255870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.256669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.257160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] PATH_INFO: `/v3/projects/b8dce5e2d75844988d64d5ab8f7fffc9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.264296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] RBAC: Authorizing `identity:delete_project(project_id=b8dce5e2d75844988d64d5ab8f7fffc9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.276585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c3a5f-4586-4c4e-a323-1d8471a9c431 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.278464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.284918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.286915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.287996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.291850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.293497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.299729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.331177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:07.336364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1130/2278] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:07.339295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.377499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7d1eb7-4b72-48e5-a6bf-4b97a375f5c6 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.388087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.389029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.389455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.389876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] PATH_INFO: `/v3/projects/c315759a4bf8469eab78504a0d2d38ba/users/dd2d1a37882b4188ad02ba2814692861/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.424786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c315759a4bf8469eab78504a0d2d38ba, user_id=dd2d1a37882b4188ad02ba2814692861, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.426497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b8dce5e2d75844988d64d5ab8f7fffc9', 'request_id': 'req-44d497e6-3bdc-4942-854f-33746f340dfa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.431516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.441562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b8dce5e2d75844988d64d5ab8f7fffc9', 'request_id': 'req-44d497e6-3bdc-4942-854f-33746f340dfa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.462097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b8dce5e2d75844988d64d5ab8f7fffc9', 'request_id': 'req-44d497e6-3bdc-4942-854f-33746f340dfa'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.472712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1131/2279] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:07 2022] PUT /identity/v3/projects/c315759a4bf8469eab78504a0d2d38ba/users/dd2d1a37882b4188ad02ba2814692861/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:07.477510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.493148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] The token cache is being invalidate because project b8dce5e2d75844988d64d5ab8f7fffc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:07.493412 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.496470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.501399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1149/2280] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:07 2022] DELETE /identity/v3/projects/b8dce5e2d75844988d64d5ab8f7fffc9 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:07.512028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.515183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:07.518755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:07.597670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d10aad5-9879-4cc5-86d1-0082b256382b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.603455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.604393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.604768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.605142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.606260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.608344 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.626099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1132/2281] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:07.627152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.631031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:07.639095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d497e6-3bdc-4942-854f-33746f340dfa admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.645188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.646312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323397cc-653e-49fb-9d9d-753d0de7df51 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:07.646552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.647375 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.647920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] PATH_INFO: `/v3/users/aea8b11857594a7298376e9c6bfbcefc` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.650065 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea8b11857594a7298376e9c6bfbcefc)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.652021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918b4f51-374e-48ec-8c75-d7a8b49f6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:07.652843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4f51-374e-48ec-8c75-d7a8b49f6c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.653222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4f51-374e-48ec-8c75-d7a8b49f6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.653379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.653677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918b4f51-374e-48ec-8c75-d7a8b49f6c3b admin admin] PATH_INFO: `/v3/projects/c315759a4bf8469eab78504a0d2d38ba/users/dd2d1a37882b4188ad02ba2814692861/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.656022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b4f51-374e-48ec-8c75-d7a8b49f6c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c315759a4bf8469eab78504a0d2d38ba, user_id=dd2d1a37882b4188ad02ba2814692861, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:07.660231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918b4f51-374e-48ec-8c75-d7a8b49f6c3b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:07.683215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1133/2282] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:07 2022] PUT /identity/v3/projects/c315759a4bf8469eab78504a0d2d38ba/users/dd2d1a37882b4188ad02ba2814692861/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:07.685158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:07.685549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:07.686348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:07.723458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] MFA Rules not processed for user `dd2d1a37882b4188ad02ba2814692861`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:07.725136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:07.743658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea8b11857594a7298376e9c6bfbcefc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.745366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea8b11857594a7298376e9c6bfbcefc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.759683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea8b11857594a7298376e9c6bfbcefc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.778163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea8b11857594a7298376e9c6bfbcefc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.801373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea8b11857594a7298376e9c6bfbcefc'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:07.823227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1150/2283] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:07 2022] DELETE /identity/v3/users/aea8b11857594a7298376e9c6bfbcefc => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:07.829896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1134/2284] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:07.846629 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:07.859638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:07.932998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:08.007841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d386df2-c931-49e6-8bca-01e323c61edc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:08.013697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:08.015564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:08.015955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:08.016591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:08.023112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:08.222189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:08.227727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa642b4a-f721-4374-84a2-f5317fdd43f6 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:08.262555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1151/2285] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:08.485999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:09.098273 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1e2915-67e9-47e7-9647-a31025ef462e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:09.160502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:09.207966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:09.207966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:09.207966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:09.208854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] PATH_INFO: `/v3/projects/03d9d147cf23460ca44ada5da58af755` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:09.210331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] RBAC: Authorizing `identity:delete_project(project_id=03d9d147cf23460ca44ada5da58af755)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:09.212473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:09.324151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03d9d147cf23460ca44ada5da58af755', 'request_id': 'req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:09.355124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03d9d147cf23460ca44ada5da58af755', 'request_id': 'req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:09.363988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03d9d147cf23460ca44ada5da58af755', 'request_id': 'req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:09.394532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] The token cache is being invalidate because project 03d9d147cf23460ca44ada5da58af755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:09.395129 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:09.396768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-71e57fc1-ed49-45c4-9e58-6babf9aaa1db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:09.405718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1135/2286] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:08 2022] DELETE /identity/v3/projects/03d9d147cf23460ca44ada5da58af755 => generated 0 bytes in 916 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:09.408497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:09.408960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:09.409074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:09.443982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:09.446829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:09.563800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1152/2287] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:09.575745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:09.576293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:09.576755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:09.631782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:09.633506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:09.647591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1136/2288] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:09.647878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:09.662452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d219b29-13c5-452d-acf5-5b813ff0e734 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:09.674189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:09.675307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:09.675652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:09.675972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:09.677876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:09.678169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:09.680972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:09.704266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1153/2289] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:09.717247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:09.735650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf9ed3e-a417-4c8e-a232-5e90a4c94234 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:09.747509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:09.748417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:09.749463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:09.749943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:09.751648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:09.754135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:09.849745 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1137/2290] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:09 2022] POST /identity/v3/projects => generated 373 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:09.854232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:09.865580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4f585b-f128-4b01-ae65-cd9e52fed0ed admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:09.975297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:09.976318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:09.977075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:09.978345 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:09.984496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:09.994055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:10.005865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:10.040957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1154/2291] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:09 2022] POST /identity/v3/users => generated 287 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:02:10.044716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:10.062696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5acce5-d228-479a-97eb-f74a29a9e0a8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:10.077124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:10.079505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:10.080910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:10.083516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:10.084358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:10.088095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:10.106343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1138/2292] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:10.107109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:10.121380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe32b670-d4c0-4334-8f32-42752c5621c5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:10.132383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b40559-98d0-4356-9d9c-ab1d29b340f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:10.134033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40559-98d0-4356-9d9c-ab1d29b340f1 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:10.134326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40559-98d0-4356-9d9c-ab1d29b340f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:10.134601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b40559-98d0-4356-9d9c-ab1d29b340f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:10.135269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40559-98d0-4356-9d9c-ab1d29b340f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:10.137686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b40559-98d0-4356-9d9c-ab1d29b340f1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:10.160530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1155/2293] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:10 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:10.161490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:10.181975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0057f4-4e01-4590-aadd-eb6f79f26d56 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:10.198004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:10.198682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:10.199360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:10.199556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] PATH_INFO: `/v3/projects/f6ce2ff6a1284fddbaf61fe3f47886fa/users/e517ccaa24ca47c4a390e1bd760564b2/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:10.224656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ce2ff6a1284fddbaf61fe3f47886fa, user_id=e517ccaa24ca47c4a390e1bd760564b2, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:10.227506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:10.249047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1139/2294] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:10 2022] PUT /identity/v3/projects/f6ce2ff6a1284fddbaf61fe3f47886fa/users/e517ccaa24ca47c4a390e1bd760564b2/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:10.255478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8dd2-d6ff-4efd-a444-d464306cc77d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:10.255976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8dd2-d6ff-4efd-a444-d464306cc77d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:10.256508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c8dd2-d6ff-4efd-a444-d464306cc77d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:10.294073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-fe0c8dd2-d6ff-4efd-a444-d464306cc77d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:10.296686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fe0c8dd2-d6ff-4efd-a444-d464306cc77d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:10.418044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1156/2295] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:10.441109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:10.445551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:10.602305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27448dc8-9216-4e27-84c9-c87a89a59a11 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:10.620778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb81f01-a4f7-4c26-b064-659dbb3e2d66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:10.623485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81f01-a4f7-4c26-b064-659dbb3e2d66 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:10.623485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81f01-a4f7-4c26-b064-659dbb3e2d66 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:10.623485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb81f01-a4f7-4c26-b064-659dbb3e2d66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:10.645312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:10.654605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81f01-a4f7-4c26-b064-659dbb3e2d66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:10.656103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb81f01-a4f7-4c26-b064-659dbb3e2d66 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:10.708510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1140/2296] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:11.855280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488fdd-26f3-4218-8fb2-a62e630e35bc None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:11.856597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488fdd-26f3-4218-8fb2-a62e630e35bc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:11.856597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06488fdd-26f3-4218-8fb2-a62e630e35bc None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:11.859171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1157/2297] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:02:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:02:11.869843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:11.870696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:11.871337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:11.908140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] MFA Rules not processed for user `526b8be76d1c4c1fbcc1c3ae97c5ead4`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:11.909520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:12.071226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1141/2298] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:02:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:12.087576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488fdd-26f3-4218-8fb2-a62e630e35bc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:12.090471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-06488fdd-26f3-4218-8fb2-a62e630e35bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:12.142634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06488fdd-26f3-4218-8fb2-a62e630e35bc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:12.163285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:12.165214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:12.169854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:12.170657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:12.200546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:12.203037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:12.217764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1158/2299] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:13.424696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:13.426260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:13.554755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaabdb3-95e6-40ad-a736-cf4fdd14c730 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:13.559043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:13.560122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:13.560615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:13.561105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:13.563660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:13.626777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:13.634654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:13.661876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2e7b6-ad58-4d47-bd5c-ce213466881f service placement] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:13.673044 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:13.673941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:13.674398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:13.674819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] PATH_INFO: `/v3/users/88fa94e9cdaa473ba72d3af58cb05925` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:13.678474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] RBAC: Authorizing `identity:delete_user(user_id=88fa94e9cdaa473ba72d3af58cb05925)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:13.680664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:13.710394 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:13.711967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5046a832-bef1-4d75-ac87-831d097dd65a service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:13.724790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1142/2300] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:13 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:13.727903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:13.728341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:13.728609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:13.766240 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] MFA Rules not processed for user `e517ccaa24ca47c4a390e1bd760564b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:13.767519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:13.838369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '88fa94e9cdaa473ba72d3af58cb05925'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:13.841672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '88fa94e9cdaa473ba72d3af58cb05925'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:13.869407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '88fa94e9cdaa473ba72d3af58cb05925'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:13.874056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:13.878647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '88fa94e9cdaa473ba72d3af58cb05925'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:13.907890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '88fa94e9cdaa473ba72d3af58cb05925'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:13.924829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1159/2301] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:13 2022] DELETE /identity/v3/users/88fa94e9cdaa473ba72d3af58cb05925 => generated 0 bytes in 301 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:14.000173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1143/2302] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:14.018993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:14.021099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:14.173643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=2,keystone:SELECT=88,keystone:DELETE=10 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:14.214210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244bdbf2-7c48-4eb0-9caf-e2172e69d347 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:14.220831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:14.225141 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:14.225911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:14.226893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:14.376219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:14.378025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:14.407896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1160/2303] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:14.729755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:14.731199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:14.771418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93090ee1-fa4f-43c3-b74b-d1555357cc43 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:14.921756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:14.922499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:14.922774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:14.923042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] PATH_INFO: `/v3/projects/3e844eaf2c784c859864c749273c01c6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:14.924409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e844eaf2c784c859864c749273c01c6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:14.927070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:15.051480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e844eaf2c784c859864c749273c01c6', 'request_id': 'req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.068257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e844eaf2c784c859864c749273c01c6', 'request_id': 'req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.088241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e844eaf2c784c859864c749273c01c6', 'request_id': 'req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.118654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] The token cache is being invalidate because project 3e844eaf2c784c859864c749273c01c6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:15.118954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.120469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.123233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1144/2304] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:14 2022] DELETE /identity/v3/projects/3e844eaf2c784c859864c749273c01c6 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:15.127916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:15.153471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66c7654-9c65-4d14-bc47-94a0de2bb3ed service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:15.273369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:15.275110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:15.276166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:15.276887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] PATH_INFO: `/v3/users/cebc4433a88b4ce0803def1bce7028f9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:15.280966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cebc4433a88b4ce0803def1bce7028f9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:15.287736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:15.436529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cebc4433a88b4ce0803def1bce7028f9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.437502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cebc4433a88b4ce0803def1bce7028f9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.455442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cebc4433a88b4ce0803def1bce7028f9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.482283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cebc4433a88b4ce0803def1bce7028f9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.533593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-a7c9cd65-9895-4108-ab6c-ad09c86942a7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cebc4433a88b4ce0803def1bce7028f9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:15.559989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1161/2305] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:15 2022] DELETE /identity/v3/users/cebc4433a88b4ce0803def1bce7028f9 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:16.121582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:16.123914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:16.156258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97dfd84-96cd-49ae-89d1-82ec941a6ec9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:16.212337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce598d41-3b8a-434d-b8b2-f764c85c0d68 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:16.213950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce598d41-3b8a-434d-b8b2-f764c85c0d68 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:16.214408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce598d41-3b8a-434d-b8b2-f764c85c0d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:16.262942 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:16.263710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:16.264159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:16.264781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] PATH_INFO: `/v3/projects/60f856a56ac64412bc17e1d74258ad80` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:16.266220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60f856a56ac64412bc17e1d74258ad80)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:16.268881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:16.272211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:16.275741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ce598d41-3b8a-434d-b8b2-f764c85c0d68 None None] MFA Rules not processed for user `e517ccaa24ca47c4a390e1bd760564b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:16.278772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ce598d41-3b8a-434d-b8b2-f764c85c0d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:16.306687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:16.393876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60f856a56ac64412bc17e1d74258ad80', 'request_id': 'req-a149c607-780a-448b-aeeb-622f1e7de037'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:16.413854 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60f856a56ac64412bc17e1d74258ad80', 'request_id': 'req-a149c607-780a-448b-aeeb-622f1e7de037'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:16.416657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1162/2306] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:16.439970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60f856a56ac64412bc17e1d74258ad80', 'request_id': 'req-a149c607-780a-448b-aeeb-622f1e7de037'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:16.486491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] The token cache is being invalidate because project 60f856a56ac64412bc17e1d74258ad80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:16.486827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:16.487765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a149c607-780a-448b-aeeb-622f1e7de037 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:16.499350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1145/2307] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:16 2022] DELETE /identity/v3/projects/60f856a56ac64412bc17e1d74258ad80 => generated 0 bytes in 376 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:16.500826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:16.501197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:16.501539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:16.548227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:16.550327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:16.717736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1163/2308] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:16.726174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:16.727998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:16.728584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:16.765920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:16.767334 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:16.782176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1146/2309] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:16.782963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:16.796068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feadccb-d452-44e6-b478-ae281772e024 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:16.808340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:16.809099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:16.809475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:16.809846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:16.814110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:16.814542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:16.816454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:16.835397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1164/2310] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:16.837228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:16.854226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e5524e-5a66-4140-8ee6-c42b82bd3830 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:16.859824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:16.860593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:16.860964 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:16.861325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:16.862204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:16.865008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:16.917860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1147/2311] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:16 2022] POST /identity/v3/projects => generated 377 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:16.922415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:16.933696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7750f-a17a-4e4f-aa46-2a99eb310c1f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:17.133969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:17.138099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.138419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.138698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.139368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:17.146400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:17.221911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1165/2312] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:16 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:17.226759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:17.246384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310e483-a0a4-4ef6-a6c2-9b3e9c1c8d0e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:17.264859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:17.266065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.266564 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.267330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.270758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:17.283161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:17.299145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1148/2313] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:17.304580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:17.325318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c726235a-dfea-4e74-9043-3140f33d96cf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:17.335576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7dd22ec-dedf-4fa7-a5f9-30c9dc1484df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:17.336370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd22ec-dedf-4fa7-a5f9-30c9dc1484df admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.336715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd22ec-dedf-4fa7-a5f9-30c9dc1484df admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.337120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dd22ec-dedf-4fa7-a5f9-30c9dc1484df admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.337785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd22ec-dedf-4fa7-a5f9-30c9dc1484df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:17.339915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7dd22ec-dedf-4fa7-a5f9-30c9dc1484df admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:17.358976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1166/2314] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:17.361959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:17.375634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b2a411-2af6-4079-96ef-f80cd2e9cd10 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:17.386399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:17.387461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.387934 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.388496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] PATH_INFO: `/v3/projects/af4d6fbcdf0a4b23a71142e3bcb89ef3/users/738b65432175458c8931e2077adf909a/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.411885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=af4d6fbcdf0a4b23a71142e3bcb89ef3, user_id=738b65432175458c8931e2077adf909a, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:17.415206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:17.435535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1149/2315] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:17 2022] PUT /identity/v3/projects/af4d6fbcdf0a4b23a71142e3bcb89ef3/users/738b65432175458c8931e2077adf909a/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:02:17.448269 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6679d-ac4c-4c43-8311-322c6e791aa6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.448591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6679d-ac4c-4c43-8311-322c6e791aa6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.448851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b6679d-ac4c-4c43-8311-322c6e791aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.481033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e1b6679d-ac4c-4c43-8311-322c6e791aa6 None None] MFA Rules not processed for user `738b65432175458c8931e2077adf909a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:17.482189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e1b6679d-ac4c-4c43-8311-322c6e791aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:17.504369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:17.609118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1167/2316] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:17.624469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:17.627016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:17.763785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bafe0-9358-4a4e-9ff1-92ef4468e154 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.764152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bafe0-9358-4a4e-9ff1-92ef4468e154 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.764440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038bafe0-9358-4a4e-9ff1-92ef4468e154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.771266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e8cc0fc-1168-4024-8f09-47398bafe8eb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:17.779654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:17.782769 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:17.783410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:17.785431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:17.808494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:17.812613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:17.822764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-038bafe0-9358-4a4e-9ff1-92ef4468e154 None None] MFA Rules not processed for user `c7415b01670942cea4a62d88edfd7222`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:17.824108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-038bafe0-9358-4a4e-9ff1-92ef4468e154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:17.840938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1150/2317] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:17 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:18.054167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1168/2318] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:17 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:18.080617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:18.091876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9834f7ba-b026-4227-804f-fa9bcab5254b service glance] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:18.107104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:18.108097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:18.108597 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:18.109056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:18.113657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:18.199239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:18.265514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:18.268938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:18.308484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1151/2319] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:18 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:18.741551 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:18.742452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:18.742883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:18.792073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:18.793697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:18.926106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1169/2320] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:02:18 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:19.010017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:19.011701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:19.123001 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711dda60-e277-436e-b473-874747a3a4b2 service glance] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:19.130881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffeb363-4903-4844-bb0e-1293505a3cde service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:19.131605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeb363-4903-4844-bb0e-1293505a3cde service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:19.131994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeb363-4903-4844-bb0e-1293505a3cde service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:19.132373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffeb363-4903-4844-bb0e-1293505a3cde service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:19.142261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeb363-4903-4844-bb0e-1293505a3cde service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:19.144113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffeb363-4903-4844-bb0e-1293505a3cde service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:19.154236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1152/2321] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:19.838899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:19.840793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:19.999557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:20.026096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac861e6-e8a2-43ac-ae0e-a3a5f4907b44 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:20.043689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:20.044386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:20.044666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:20.044943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] PATH_INFO: `/v3/users/64dd0ba9afed4cd394a56d5dd74a1a67` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:20.053567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=64dd0ba9afed4cd394a56d5dd74a1a67)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:20.055538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:20.174546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64dd0ba9afed4cd394a56d5dd74a1a67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:20.175252 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64dd0ba9afed4cd394a56d5dd74a1a67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:20.189049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64dd0ba9afed4cd394a56d5dd74a1a67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:20.200465 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64dd0ba9afed4cd394a56d5dd74a1a67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:20.226614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64dd0ba9afed4cd394a56d5dd74a1a67'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:20.245658 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1170/2322] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:19 2022] DELETE /identity/v3/users/64dd0ba9afed4cd394a56d5dd74a1a67 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:20.251201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:20.252222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:20.252953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:20.287141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:20.290416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:20.403045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1153/2323] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:20.420229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:20.422002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:20.560253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa75515-5640-493f-9229-4fb30eaed9a6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:20.572969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:20.573943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:20.574371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:20.575401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:20.594390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:20.596182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:20.612094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1171/2324] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:21.097864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:21.101088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:21.130491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c731d9-a912-4755-b77f-8345b48d2ed2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:21.153518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:21.154358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:21.154792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:21.155220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] PATH_INFO: `/v3/projects/231868a4f51f448aa7135f1fa7def95c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:21.157308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] RBAC: Authorizing `identity:delete_project(project_id=231868a4f51f448aa7135f1fa7def95c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:21.179402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:21.337489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '231868a4f51f448aa7135f1fa7def95c', 'request_id': 'req-1bd6f4bf-a032-4d75-94dc-4a4a173129be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.343786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:21.352639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '231868a4f51f448aa7135f1fa7def95c', 'request_id': 'req-1bd6f4bf-a032-4d75-94dc-4a4a173129be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.369701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '231868a4f51f448aa7135f1fa7def95c', 'request_id': 'req-1bd6f4bf-a032-4d75-94dc-4a4a173129be'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.398851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] The token cache is being invalidate because project 231868a4f51f448aa7135f1fa7def95c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:21.399965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.401355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.403445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1154/2325] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:21 2022] DELETE /identity/v3/projects/231868a4f51f448aa7135f1fa7def95c => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:21.407649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:21.430361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37407499-04f5-48c1-a298-952c41634c28 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:21.582289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:21.583636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:21.583917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:21.584217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] PATH_INFO: `/v3/users/dd2d1a37882b4188ad02ba2814692861` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:21.586028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] RBAC: Authorizing `identity:delete_user(user_id=dd2d1a37882b4188ad02ba2814692861)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:21.592700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:21.620307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:21.714760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dd2d1a37882b4188ad02ba2814692861'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.715585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dd2d1a37882b4188ad02ba2814692861'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.730781 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dd2d1a37882b4188ad02ba2814692861'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.755314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dd2d1a37882b4188ad02ba2814692861'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.779990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f52a7f5d-3102-4f42-ac35-2b2b09d2f2da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dd2d1a37882b4188ad02ba2814692861'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:21.799025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1172/2326] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:21 2022] DELETE /identity/v3/users/dd2d1a37882b4188ad02ba2814692861 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:22.492210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:22.493633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:22.533652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6f4bf-a032-4d75-94dc-4a4a173129be admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:22.676711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:22.679997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:22.680911 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:22.681130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] PATH_INFO: `/v3/projects/c315759a4bf8469eab78504a0d2d38ba` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:22.682567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c315759a4bf8469eab78504a0d2d38ba)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:22.687282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:22.784753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c315759a4bf8469eab78504a0d2d38ba', 'request_id': 'req-312d0179-e054-4abb-b1c7-248c03f7cda9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:22.794468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c315759a4bf8469eab78504a0d2d38ba', 'request_id': 'req-312d0179-e054-4abb-b1c7-248c03f7cda9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:22.820677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c315759a4bf8469eab78504a0d2d38ba', 'request_id': 'req-312d0179-e054-4abb-b1c7-248c03f7cda9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:22.880776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] The token cache is being invalidate because project c315759a4bf8469eab78504a0d2d38ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:22.881045 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:22.883877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-312d0179-e054-4abb-b1c7-248c03f7cda9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:22.887004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1155/2327] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:22 2022] DELETE /identity/v3/projects/c315759a4bf8469eab78504a0d2d38ba => generated 0 bytes in 395 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:22.893257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:22.897049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:22.897402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:22.949507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:22.953138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:23.066616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.067941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.068438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.076697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1173/2328] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:23.090795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:23.092581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:23.114529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1156/2329] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:23.118704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.130071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e08ebf6-002f-4ebd-ac25-cb44a6ff24dc None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.134987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.135593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.135873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.136180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.136832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:23.137135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.138738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.157136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1174/2330] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:23.158819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.190568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe51f2b-687d-4fbc-b2c2-e0b451643805 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.198285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.198888 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.199211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.199486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.200148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.202097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.241342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1157/2331] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:23 2022] POST /identity/v3/projects => generated 385 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:02:23.245048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.257278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8552079-0395-4f3e-af17-1bc710f80a58 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.371640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.372293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.372575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.372850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.373490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.375511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.409322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1175/2332] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:23 2022] POST /identity/v3/users => generated 293 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:23.413323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.429163 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dfa0be-8287-4389-a2ea-42e9c8752fd2 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.436491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.437118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.437401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.437672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.438473 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.440096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.459463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1158/2333] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:23.463544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.470627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:23.477126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c07813-329b-49a8-8bc7-f729d8ba046c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.488828 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aeff92-53ae-472b-a069-b46fcaf30028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.489578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeff92-53ae-472b-a069-b46fcaf30028 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.489916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeff92-53ae-472b-a069-b46fcaf30028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.490126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aeff92-53ae-472b-a069-b46fcaf30028 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.492755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeff92-53ae-472b-a069-b46fcaf30028 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.497058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aeff92-53ae-472b-a069-b46fcaf30028 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.514387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1176/2334] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:23 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:23.515615 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.530907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebee9ef-4cf1-47ba-b782-b77620926603 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.553529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.556176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.556843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.557328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] PATH_INFO: `/v3/projects/92c8194453dc49bd8521d8d3375d04ac/users/18ad191b148e44188a50745782e49eb6/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.576452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] RBAC: Authorizing `identity:create_grant(project_id=92c8194453dc49bd8521d8d3375d04ac, user_id=18ad191b148e44188a50745782e49eb6, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.579469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.597890 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1159/2335] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:23 2022] PUT /identity/v3/projects/92c8194453dc49bd8521d8d3375d04ac/users/18ad191b148e44188a50745782e49eb6/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:23.610704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.611218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.611602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.652802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] MFA Rules not processed for user `18ad191b148e44188a50745782e49eb6`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:23.654215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:23.748206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1177/2336] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:23 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:23.756390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:23.758504 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:23.773250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:23.854606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284c27e8-dc3d-4632-a1b4-bc31c7819844 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:23.866843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a51918-b32d-4254-bb7b-9408f5ad1b25 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:23.867767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51918-b32d-4254-bb7b-9408f5ad1b25 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:23.868248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51918-b32d-4254-bb7b-9408f5ad1b25 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:23.868669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a51918-b32d-4254-bb7b-9408f5ad1b25 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:23.881448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a51918-b32d-4254-bb7b-9408f5ad1b25 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:23.882988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a51918-b32d-4254-bb7b-9408f5ad1b25 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:23.904994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1160/2337] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:23 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:23.916873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:24.067007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2506b7bf-f1a9-447c-9dab-39691b043f96 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:24.072583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:24.073247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:24.073598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:24.073942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] PATH_INFO: `/v3/users/18ad191b148e44188a50745782e49eb6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:24.089241 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18ad191b148e44188a50745782e49eb6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:24.104081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:24.261757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18ad191b148e44188a50745782e49eb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:24.264648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18ad191b148e44188a50745782e49eb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:24.280729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18ad191b148e44188a50745782e49eb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:24.303343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18ad191b148e44188a50745782e49eb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:24.346528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18ad191b148e44188a50745782e49eb6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:24.356452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1178/2338] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:23 2022] DELETE /identity/v3/users/18ad191b148e44188a50745782e49eb6 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:24.361361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:24.361706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:24.362062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:24.396989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:24.398720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:24.487795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1161/2339] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:24.495729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:24.498376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:24.507964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:24.605582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6313ad73-2588-4680-8751-1c347be65a29 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:24.611119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b793e3-1c65-4d29-94ef-cc1a5a057e18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:24.612387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b793e3-1c65-4d29-94ef-cc1a5a057e18 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:24.612850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b793e3-1c65-4d29-94ef-cc1a5a057e18 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:24.614864 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b793e3-1c65-4d29-94ef-cc1a5a057e18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:24.627750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b793e3-1c65-4d29-94ef-cc1a5a057e18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:24.629996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b793e3-1c65-4d29-94ef-cc1a5a057e18 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:24.653995 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1179/2340] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:26.114337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:26.121614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:26.164933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08c4cf5-38b8-4d2c-8aba-78bbe7acb1e5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:26.193904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:26.194833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.195287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.195709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] PATH_INFO: `/v3/projects/92c8194453dc49bd8521d8d3375d04ac` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.203413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] RBAC: Authorizing `identity:delete_project(project_id=92c8194453dc49bd8521d8d3375d04ac)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:26.207113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:26.290985 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92c8194453dc49bd8521d8d3375d04ac', 'request_id': 'req-4578280f-e7b6-4343-8cc7-9941bf5b75ea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:26.297332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92c8194453dc49bd8521d8d3375d04ac', 'request_id': 'req-4578280f-e7b6-4343-8cc7-9941bf5b75ea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:26.306133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92c8194453dc49bd8521d8d3375d04ac', 'request_id': 'req-4578280f-e7b6-4343-8cc7-9941bf5b75ea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:26.322210 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] The token cache is being invalidate because project 92c8194453dc49bd8521d8d3375d04ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:26.322577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:26.323287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4578280f-e7b6-4343-8cc7-9941bf5b75ea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:26.325399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1162/2341] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:26 2022] DELETE /identity/v3/projects/92c8194453dc49bd8521d8d3375d04ac => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:26.330911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.331830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.332821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.358514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:26.359896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:26.452162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1180/2342] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:26.453841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.454117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.454384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.482717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:26.483925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:26.498351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1163/2343] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:26.499969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:26.514837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f297c7-9e40-45b0-9879-e533eb7caa18 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:26.521026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:26.521860 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.522327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.522759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.523565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:26.524032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:26.525824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:26.540596 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1181/2344] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:02:26.544989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:26.566335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecafe4-6e70-4d52-875c-9d58db8fde53 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:26.584509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:26.585244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.585522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.586007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.586758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:26.589004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:26.689368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:26.701508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1164/2345] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:26 2022] POST /identity/v3/projects => generated 363 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:26.704147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45b245d-8166-43a5-b36b-67c484bfa4dc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:26.865058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:26.865755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.866002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.866363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.867035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:26.869312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:26.945327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1182/2346] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:26 2022] POST /identity/v3/users => generated 282 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:26.955632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:26.976212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d658edc5-8714-43ac-b534-342a66c8a365 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:26.981781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:26.981996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:26.982261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:26.982501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:26.983160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:26.985070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:26.986809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:27.006222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1165/2347] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:26 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:27.008531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:27.023427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d1da3f-cadb-40e5-870c-a00a8675be79 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:27.032886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f9a3-f191-4293-b360-b2aab392d038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:27.033518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f9a3-f191-4293-b360-b2aab392d038 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:27.033802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f9a3-f191-4293-b360-b2aab392d038 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:27.034078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f9a3-f191-4293-b360-b2aab392d038 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:27.034743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7f9a3-f191-4293-b360-b2aab392d038 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:27.036608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7f9a3-f191-4293-b360-b2aab392d038 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:27.064956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1183/2348] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:27.070242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:27.082880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3018e842-739c-4adf-944b-b30bc673662e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:27.088346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:27.089034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:27.089314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:27.089583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] PATH_INFO: `/v3/projects/546d64aebf924d528dce2e1c621e854c/users/17b09aa543444ab39445c43df53d9afb/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:27.112195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] RBAC: Authorizing `identity:create_grant(project_id=546d64aebf924d528dce2e1c621e854c, user_id=17b09aa543444ab39445c43df53d9afb, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:27.115440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:27.137658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1166/2349] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:27 2022] PUT /identity/v3/projects/546d64aebf924d528dce2e1c621e854c/users/17b09aa543444ab39445c43df53d9afb/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:02:27.148811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0397-daff-491a-9d3c-cb8cfa4b0d3d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:27.149096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0397-daff-491a-9d3c-cb8cfa4b0d3d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:27.149369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568b0397-daff-491a-9d3c-cb8cfa4b0d3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:27.172727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:27.190598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-568b0397-daff-491a-9d3c-cb8cfa4b0d3d None None] MFA Rules not processed for user `17b09aa543444ab39445c43df53d9afb`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:27.197014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-568b0397-daff-491a-9d3c-cb8cfa4b0d3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:27.365665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1184/2350] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:27 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:27.378204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:27.380498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:27.486362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abce237c-3a04-4ba1-9d66-ca70cf2aad9b admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:27.490596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:27.491794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:27.492360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:27.492779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:27.503574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:27.507673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:27.523218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1167/2351] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:27 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:30.073800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ccf3-df88-48a0-a9bd-127ffaa21a5d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.077001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ccf3-df88-48a0-a9bd-127ffaa21a5d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.077548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c9ccf3-df88-48a0-a9bd-127ffaa21a5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.098673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c8c9ccf3-df88-48a0-a9bd-127ffaa21a5d None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:30.100103 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c8c9ccf3-df88-48a0-a9bd-127ffaa21a5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.161955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1185/2352] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:02:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:30.178636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:30.180254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:30.284652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f180745e-9b70-426d-a35c-8a7d31a50c46 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:30.290416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:30.293303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:30.293574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:30.293851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:30.303796 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:30.305404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:30.314529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1168/2353] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:31.023865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388634-8adc-4f41-8ccd-0650afc54cc1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.024231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388634-8adc-4f41-8ccd-0650afc54cc1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.024542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32388634-8adc-4f41-8ccd-0650afc54cc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.062542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-32388634-8adc-4f41-8ccd-0650afc54cc1 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:31.064070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-32388634-8adc-4f41-8ccd-0650afc54cc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:31.078817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1186/2354] 10.222.0.72 () {58 vars in 967 bytes} [Thu Aug 25 03:02:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:31.086411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:31.098554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371b7273-a926-439d-ae17-feda3d1bb9af service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:31.118640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:31.119369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.119722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.120082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.168378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:31.170178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:31.203295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1169/2355] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:31.552842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96396-d767-4089-b628-030079984099 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.553130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96396-d767-4089-b628-030079984099 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.553409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf96396-d767-4089-b628-030079984099 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.574580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ccf96396-d767-4089-b628-030079984099 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:31.575830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ccf96396-d767-4089-b628-030079984099 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:31.589863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1187/2356] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:02:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:31.605780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:31.624395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1a5245-5f32-492d-b11f-db994d0eb3a9 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:31.635431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:31.636156 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:31.637057 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:31.637515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:31.650146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:31.651857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:31.662023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1170/2357] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:32.314051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6c0a-c664-4711-a618-959b30571cfe None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.314621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6c0a-c664-4711-a618-959b30571cfe None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.314621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ef6c0a-c664-4711-a618-959b30571cfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.346680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e9ef6c0a-c664-4711-a618-959b30571cfe None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:32.347939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e9ef6c0a-c664-4711-a618-959b30571cfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:32.374235 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1188/2358] 10.222.0.72 () {58 vars in 967 bytes} [Thu Aug 25 03:02:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:32.390483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:32.405180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d360da-e9cf-479a-b603-a17c98ea1b3c service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:32.427946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:32.429065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.429379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.429759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.449722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:32.451697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:32.476784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1171/2359] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:32.733457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537ff9-9cf1-46a5-857b-007dfc762b45 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:32.733819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537ff9-9cf1-46a5-857b-007dfc762b45 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:32.734127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b537ff9-9cf1-46a5-857b-007dfc762b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:32.757473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0b537ff9-9cf1-46a5-857b-007dfc762b45 None None] MFA Rules not processed for user `213b3d0bd2714b13b344a16992196409`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:32.758681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0b537ff9-9cf1-46a5-857b-007dfc762b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:32.820722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1189/2360] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:32 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:34.803132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:34.804613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:34.834974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:34.887174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e8a54-8fcd-4c32-93c1-dd56955dcb77 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:34.891937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:34.892641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:34.892939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:34.893213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] PATH_INFO: `/v3/users/ab215223f5304b7ea659ac62416e50c9` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:34.894321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab215223f5304b7ea659ac62416e50c9)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:34.896978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:34.954122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab215223f5304b7ea659ac62416e50c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:34.954808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab215223f5304b7ea659ac62416e50c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:34.970627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab215223f5304b7ea659ac62416e50c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:34.980254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab215223f5304b7ea659ac62416e50c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:34.988630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab215223f5304b7ea659ac62416e50c9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:34.995434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1172/2361] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:34 2022] DELETE /identity/v3/users/ab215223f5304b7ea659ac62416e50c9 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:35.000248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191769-ede1-495f-a995-f94292564156 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:35.000716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191769-ede1-495f-a995-f94292564156 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:35.000797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64191769-ede1-495f-a995-f94292564156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:35.027943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-64191769-ede1-495f-a995-f94292564156 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:35.029782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-64191769-ede1-495f-a995-f94292564156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:35.070795 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:35.113132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1190/2362] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:35.123943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:35.125537 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:35.260095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f0e6745-cc70-4721-b4dd-b4c186ae7d6c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:35.265701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f53ad92-a049-431d-90d5-d876b2b11f75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:35.266426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ad92-a049-431d-90d5-d876b2b11f75 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:35.266589 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ad92-a049-431d-90d5-d876b2b11f75 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:35.267387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f53ad92-a049-431d-90d5-d876b2b11f75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:35.279361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53ad92-a049-431d-90d5-d876b2b11f75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:35.281166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f53ad92-a049-431d-90d5-d876b2b11f75 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:35.295358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1173/2363] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:02:35.584628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191769-ede1-495f-a995-f94292564156 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:35.586374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-64191769-ede1-495f-a995-f94292564156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:35.612193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64191769-ede1-495f-a995-f94292564156 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:35.625924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:35.626733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:35.627474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:35.630730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] PATH_INFO: `/v3/projects/d0e1a635f2b443b8843106d1c449da9b` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:35.641332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e1a635f2b443b8843106d1c449da9b)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:35.644671 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:35.705099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:35.705416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:35.705654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:35.727757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:35.729009 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:35.752784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e1a635f2b443b8843106d1c449da9b', 'request_id': 'req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:35.761570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e1a635f2b443b8843106d1c449da9b', 'request_id': 'req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:35.777789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e1a635f2b443b8843106d1c449da9b', 'request_id': 'req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:35.804166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:35.808662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] The token cache is being invalidate because project d0e1a635f2b443b8843106d1c449da9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:35.809282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:35.810460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:35.812942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1191/2364] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:35 2022] DELETE /identity/v3/projects/d0e1a635f2b443b8843106d1c449da9b => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:35.856380 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1174/2365] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:02:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:35.868263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:35.870657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:36.074394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ec3a3a-c350-4774-b526-db4ea1da9fe6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:36.082962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a601f7e-c7bc-471b-abe9-3b3cc86f55fa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:36.084093 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601f7e-c7bc-471b-abe9-3b3cc86f55fa service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:36.084532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601f7e-c7bc-471b-abe9-3b3cc86f55fa service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:36.085043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a601f7e-c7bc-471b-abe9-3b3cc86f55fa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:36.097334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a601f7e-c7bc-471b-abe9-3b3cc86f55fa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:36.099593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a601f7e-c7bc-471b-abe9-3b3cc86f55fa service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:36.139151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1192/2366] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:36.883304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:36.886173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:37.185774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fac116-9e13-4bc4-9107-351c0560af8d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:37.205445 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:37.206405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.207293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.208113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] PATH_INFO: `/v3/users/738b65432175458c8931e2077adf909a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.226686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=738b65432175458c8931e2077adf909a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:37.234486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:37.457733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '738b65432175458c8931e2077adf909a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:37.459464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '738b65432175458c8931e2077adf909a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:37.552660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '738b65432175458c8931e2077adf909a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:37.567750 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '738b65432175458c8931e2077adf909a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:37.590407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '738b65432175458c8931e2077adf909a'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:37.599659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1175/2367] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:36 2022] DELETE /identity/v3/users/738b65432175458c8931e2077adf909a => generated 0 bytes in 719 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:37.604936 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:37.605453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:37.605453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:37.645577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:37.656930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:37.771161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:37.826013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1193/2368] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:37.961727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:37.963801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:38.089846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca3c6f2-55c8-4ff2-bb31-cbb63ef5a2d7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.094049 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a698ebc-df51-4c35-9194-b66138f380a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.094946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698ebc-df51-4c35-9194-b66138f380a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.095390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698ebc-df51-4c35-9194-b66138f380a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.095517 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a698ebc-df51-4c35-9194-b66138f380a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.105990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698ebc-df51-4c35-9194-b66138f380a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.107475 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a698ebc-df51-4c35-9194-b66138f380a6 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:38.142220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1176/2369] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:38.876694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:38.878491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:38.904452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc4743d-0789-4682-a008-4b9c9950ae23 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:38.923732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:38.925273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:38.926104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:38.928226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] PATH_INFO: `/v3/projects/af4d6fbcdf0a4b23a71142e3bcb89ef3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:38.930633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af4d6fbcdf0a4b23a71142e3bcb89ef3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:38.944601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.027106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af4d6fbcdf0a4b23a71142e3bcb89ef3', 'request_id': 'req-27a273a7-7ea0-4dce-9747-5f6afde75024'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:39.040550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af4d6fbcdf0a4b23a71142e3bcb89ef3', 'request_id': 'req-27a273a7-7ea0-4dce-9747-5f6afde75024'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:39.056720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af4d6fbcdf0a4b23a71142e3bcb89ef3', 'request_id': 'req-27a273a7-7ea0-4dce-9747-5f6afde75024'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:39.095682 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] The token cache is being invalidate because project af4d6fbcdf0a4b23a71142e3bcb89ef3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:39.097782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:39.100705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-27a273a7-7ea0-4dce-9747-5f6afde75024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:39.103949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1194/2370] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:38 2022] DELETE /identity/v3/projects/af4d6fbcdf0a4b23a71142e3bcb89ef3 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:39.108958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.109491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.109491 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.163982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:39.165574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:39.184515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:39.303322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1177/2371] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:39.320488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.321196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.321737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.357502 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:39.358983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:39.375455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1195/2372] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:39.375620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:39.393962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df613a5b-5cb1-4d30-8c97-e74fd89500f4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:39.399306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:39.401476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.402036 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.402520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.403355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:39.403859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:39.405684 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.433528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1178/2373] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:39.438381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:39.451381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41141b1e-d9cb-4605-bef7-8a4e354dacaa None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:39.463444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:39.464395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.464676 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.464946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.465755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:39.467850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.517885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1196/2374] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:39 2022] POST /identity/v3/projects => generated 375 bytes in 80 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:39.523185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:39.538081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b857f7bf-cb7c-4857-b433-a80dff494306 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:39.620397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:39.620936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.621215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.621553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.622291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:39.624459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.662570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1179/2375] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:39 2022] POST /identity/v3/users => generated 288 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:39.665604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:39.684168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c60a6e0-9392-4a0e-b61a-4534ccacfd81 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:39.690949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:39.691978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.692674 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.693311 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.694323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:39.696638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.740537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1197/2376] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:39.742521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:39.757956 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dceb016-2fc1-4966-be23-e8b9815033e5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:39.764228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427a4f54-e92e-4247-89ac-bfaa4a1c2e29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:39.765159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a4f54-e92e-4247-89ac-bfaa4a1c2e29 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.766122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a4f54-e92e-4247-89ac-bfaa4a1c2e29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.766634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427a4f54-e92e-4247-89ac-bfaa4a1c2e29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.767514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a4f54-e92e-4247-89ac-bfaa4a1c2e29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:39.769642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427a4f54-e92e-4247-89ac-bfaa4a1c2e29 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.786242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1180/2377] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:02:39.790632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:39.803001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae790d4f-dc00-4ed5-ac1a-3469eb9bb30b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:39.808830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:39.809654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.810194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.810646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] PATH_INFO: `/v3/projects/42a6fe0180274beba51dd9c7cb2405ea/users/a56e65d63d7a43409551b8a0ee85081f/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.829435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42a6fe0180274beba51dd9c7cb2405ea, user_id=a56e65d63d7a43409551b8a0ee85081f, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:39.833385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:39.865515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1198/2378] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:39 2022] PUT /identity/v3/projects/42a6fe0180274beba51dd9c7cb2405ea/users/a56e65d63d7a43409551b8a0ee85081f/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:02:39.876447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:39.876785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:39.877443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:39.914142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] MFA Rules not processed for user `a56e65d63d7a43409551b8a0ee85081f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:39.916907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:40.002277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1181/2379] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:40.004386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.114428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0f0eb0-2449-4812-ae7b-ab7fe68207a1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.120571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.121253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.121538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.121818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.122469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:40.124877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:40.135984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:40.155931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1199/2380] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:40 2022] POST /identity/v3/projects => generated 375 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:40.160732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.173253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4afbcee3-9a91-4fea-88d2-c3bb256c2200 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.178918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:40.270661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.271709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.272680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.272680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.273604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:40.275619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:40.340402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1182/2381] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:40 2022] POST /identity/v3/users => generated 294 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:40.340837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.364293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94aa7dc-864a-482e-8272-5a4746a2df2f admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.369831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.370643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.371078 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.371516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.372496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:40.374684 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:40.391010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1200/2382] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:40.392319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.403441 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15bb9cfd-66d3-4654-a09e-5b1dd105dfcf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.408885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.409629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.410849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.411143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] PATH_INFO: `/v3/projects/c4cfabb75bf2402692f83ef7090dc629/users/e6ead35099914c3b87493a5aa68dbaea/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.456203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cfabb75bf2402692f83ef7090dc629, user_id=e6ead35099914c3b87493a5aa68dbaea, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:40.456203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:40.477781 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1183/2383] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:40 2022] PUT /identity/v3/projects/c4cfabb75bf2402692f83ef7090dc629/users/e6ead35099914c3b87493a5aa68dbaea/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:40.481387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.502693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1041541a-c69d-4849-9784-7bc9126d049e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.584784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3571da-3237-4ed9-951d-96fb7853168d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.585485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3571da-3237-4ed9-951d-96fb7853168d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.585715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3571da-3237-4ed9-951d-96fb7853168d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.585986 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3571da-3237-4ed9-951d-96fb7853168d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.586819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3571da-3237-4ed9-951d-96fb7853168d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:40.595161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3571da-3237-4ed9-951d-96fb7853168d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:40.612840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1201/2384] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:40 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:40.614152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.627229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d07e3d9-0d75-479f-9002-d414d6bd15dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.632945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.633607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.633887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.634158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] PATH_INFO: `/v3/projects/c4cfabb75bf2402692f83ef7090dc629/users/e6ead35099914c3b87493a5aa68dbaea/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.636401 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4cfabb75bf2402692f83ef7090dc629, user_id=e6ead35099914c3b87493a5aa68dbaea, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:40.639638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:40.652461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1184/2385] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:40 2022] PUT /identity/v3/projects/c4cfabb75bf2402692f83ef7090dc629/users/e6ead35099914c3b87493a5aa68dbaea/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:02:40.666747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.666747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.666747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:40.709007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] MFA Rules not processed for user `e6ead35099914c3b87493a5aa68dbaea`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:40.710703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:40.813954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1202/2386] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:40 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:40.826687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:40.828457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:40.910148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3899b134-28bd-4427-b1ff-32c782e7d74f admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:40.914353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a99e79-f71c-4fcd-929c-15e327cc65e2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:40.920885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99e79-f71c-4fcd-929c-15e327cc65e2 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:40.921305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99e79-f71c-4fcd-929c-15e327cc65e2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:40.921635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a99e79-f71c-4fcd-929c-15e327cc65e2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:41.009308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99e79-f71c-4fcd-929c-15e327cc65e2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:41.011035 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a99e79-f71c-4fcd-929c-15e327cc65e2 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:41.022088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1185/2387] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:40 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:43.959524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:44.069350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02775416-4c44-4598-9af4-c9b9cdfe6e9e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:44.074536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:44.075283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:44.075633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:44.075972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] PATH_INFO: `/v3/users/a56e65d63d7a43409551b8a0ee85081f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:44.077207 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=a56e65d63d7a43409551b8a0ee85081f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:44.079796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:44.083150 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:44.155425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a56e65d63d7a43409551b8a0ee85081f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:44.156294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a56e65d63d7a43409551b8a0ee85081f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:44.169985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a56e65d63d7a43409551b8a0ee85081f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:44.193796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a56e65d63d7a43409551b8a0ee85081f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:44.224678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a56e65d63d7a43409551b8a0ee85081f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:44.235411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1203/2388] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:43 2022] DELETE /identity/v3/users/a56e65d63d7a43409551b8a0ee85081f => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:44.240639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:44.241777 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:44.242247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:44.279583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:44.281167 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:44.298861 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:44.410969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1186/2389] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:44.423863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:44.425825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:44.538718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa4d4f03-b2e4-4094-ad93-612893937c6c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:44.544266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:44.560366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:44.560366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:44.560366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:44.573508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:44.575180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:44.595438 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1204/2390] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:45.145215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:45.146633 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:45.158664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a6182-98d8-4bb2-89db-bd6c55b113ab None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:45.163971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:45.164634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:45.164909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:45.165181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] PATH_INFO: `/v3/projects/42a6fe0180274beba51dd9c7cb2405ea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:45.166306 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42a6fe0180274beba51dd9c7cb2405ea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:45.168638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:45.219390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42a6fe0180274beba51dd9c7cb2405ea', 'request_id': 'req-6b1549cd-676f-4ae9-87fa-86cd2b01c854'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.225868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42a6fe0180274beba51dd9c7cb2405ea', 'request_id': 'req-6b1549cd-676f-4ae9-87fa-86cd2b01c854'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.232390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42a6fe0180274beba51dd9c7cb2405ea', 'request_id': 'req-6b1549cd-676f-4ae9-87fa-86cd2b01c854'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.245243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] The token cache is being invalidate because project 42a6fe0180274beba51dd9c7cb2405ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:45.245865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.246194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.247770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1187/2391] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:45 2022] DELETE /identity/v3/projects/42a6fe0180274beba51dd9c7cb2405ea => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:45.252264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:45.262395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bc7157-bca4-4ead-b556-7f64fdd9c6d2 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:45.321218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:45.321886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:45.322169 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:45.322442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] PATH_INFO: `/v3/users/e6ead35099914c3b87493a5aa68dbaea` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:45.323580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6ead35099914c3b87493a5aa68dbaea)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:45.325532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:45.349678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:45.379655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6ead35099914c3b87493a5aa68dbaea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.380335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6ead35099914c3b87493a5aa68dbaea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.388826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6ead35099914c3b87493a5aa68dbaea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.398331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6ead35099914c3b87493a5aa68dbaea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.417184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-02636219-1088-4f29-820e-7af2b0bd36b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6ead35099914c3b87493a5aa68dbaea'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:45.426114 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1205/2392] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:45 2022] DELETE /identity/v3/users/e6ead35099914c3b87493a5aa68dbaea => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:45.846221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:45.848773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:45.869449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1549cd-676f-4ae9-87fa-86cd2b01c854 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:45.952652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:45.953285 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:45.953557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:45.953825 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] PATH_INFO: `/v3/projects/c4cfabb75bf2402692f83ef7090dc629` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:45.955016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4cfabb75bf2402692f83ef7090dc629)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:45.958102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.020436 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:46.032021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4cfabb75bf2402692f83ef7090dc629', 'request_id': 'req-3ad3128f-f911-4137-a50e-f81a5566feb6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:46.040756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4cfabb75bf2402692f83ef7090dc629', 'request_id': 'req-3ad3128f-f911-4137-a50e-f81a5566feb6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:46.050351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4cfabb75bf2402692f83ef7090dc629', 'request_id': 'req-3ad3128f-f911-4137-a50e-f81a5566feb6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:46.067042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] The token cache is being invalidate because project c4cfabb75bf2402692f83ef7090dc629 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:46.067331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:46.067994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3ad3128f-f911-4137-a50e-f81a5566feb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:46.069720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1188/2393] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:45 2022] DELETE /identity/v3/projects/c4cfabb75bf2402692f83ef7090dc629 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:46.074757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.075153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.075528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.096861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:46.099038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.169989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1206/2394] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:46.178778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.179230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.179512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.200172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:46.201361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.209920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1189/2395] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:46.214381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.225604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4789eef9-0207-4b6a-909c-ed4c28ab472b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.230831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.233323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.233678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.234092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.234756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:02:46.235139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.236893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.253751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1207/2396] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:02:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:02:46.256024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.265437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f37170-f518-4475-bb55-d9a9af0083f8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.271241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.271914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.272232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.272571 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.273199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.275426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.305358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1190/2397] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/projects => generated 399 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:46.309297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.319933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f3d8b8-92ba-4afd-95c2-6cd527874140 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.379690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.380422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.380708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.380984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.381635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.383572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.406100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1208/2398] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:02:46.410926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.421434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2316fc-7349-4f9b-aebd-9fcd1e05f16e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.427287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.427906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.428186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.428538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.429357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.431022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.442109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1191/2399] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:02:46.445978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.455850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478605eb-9c39-4bc7-9dbd-5dcd4d20240c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.460950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781a6016-d071-4cf2-91dc-0c539be1401c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.461532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6016-d071-4cf2-91dc-0c539be1401c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.461806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6016-d071-4cf2-91dc-0c539be1401c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.462074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781a6016-d071-4cf2-91dc-0c539be1401c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.462735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6016-d071-4cf2-91dc-0c539be1401c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.464346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781a6016-d071-4cf2-91dc-0c539be1401c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.474957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1209/2400] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:02:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:02:46.479022 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.489592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390007c7-dd24-4e9b-95f5-4fb07e88dd89 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.494483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.495125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.495403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.495672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] PATH_INFO: `/v3/projects/6124bc03573041c6bf65d8b85a12a72c/users/800d4e04d1884d94b0e9030ea3c394a9/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.511387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6124bc03573041c6bf65d8b85a12a72c, user_id=800d4e04d1884d94b0e9030ea3c394a9, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.514116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.530688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1192/2401] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:02:46 2022] PUT /identity/v3/projects/6124bc03573041c6bf65d8b85a12a72c/users/800d4e04d1884d94b0e9030ea3c394a9/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:02:46.542205 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb728db-2366-49d6-acdb-0c8b4639ee4f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.542593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb728db-2366-49d6-acdb-0c8b4639ee4f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.542982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb728db-2366-49d6-acdb-0c8b4639ee4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.558930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:46.577363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-dcb728db-2366-49d6-acdb-0c8b4639ee4f None None] MFA Rules not processed for user `800d4e04d1884d94b0e9030ea3c394a9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:46.578552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-dcb728db-2366-49d6-acdb-0c8b4639ee4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.660316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1210/2402] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:02:46.672500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:46.674288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.760426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93477a-5cb6-47d2-8350-301def13d7c8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:46.764772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:46.765199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.765570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.765951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.776272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:46.777832 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:46.791438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1193/2403] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:46 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:46.817342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:46.817342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:46.817342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:46.845826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:46.848566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:46.989791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1211/2404] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:02:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:47.005011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:47.006551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:47.113171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f5fae66-d88a-4595-964f-50413da0f321 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:47.119124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20b30733-6da6-4d48-8f4c-d9968396710a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:47.119844 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30733-6da6-4d48-8f4c-d9968396710a service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:47.120245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30733-6da6-4d48-8f4c-d9968396710a service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:47.120638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b30733-6da6-4d48-8f4c-d9968396710a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:47.130393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30733-6da6-4d48-8f4c-d9968396710a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:47.132122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20b30733-6da6-4d48-8f4c-d9968396710a service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:47.135879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:47.142496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1194/2405] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:02:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:02:52.214669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:52.291402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ceba7e7-feba-4ba1-b438-53e882c852de None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:52.300408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:52.301578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:52.302016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:52.303037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] PATH_INFO: `/v3/users/800d4e04d1884d94b0e9030ea3c394a9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.304500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=800d4e04d1884d94b0e9030ea3c394a9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:52.314782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:52.383713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:02:52.387699 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '800d4e04d1884d94b0e9030ea3c394a9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:52.389472 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '800d4e04d1884d94b0e9030ea3c394a9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:52.409642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '800d4e04d1884d94b0e9030ea3c394a9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:52.427501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '800d4e04d1884d94b0e9030ea3c394a9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:52.469247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '800d4e04d1884d94b0e9030ea3c394a9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:52.481593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1212/2406] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:02:52 2022] DELETE /identity/v3/users/800d4e04d1884d94b0e9030ea3c394a9 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:52.485819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:52.486382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:52.486382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.515356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:52.518170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:52.606460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1195/2407] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:02:52.617239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:52.618728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:52.710075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12de5f89-59bf-4fac-9cb4-0378f8f8d255 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:52.715548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbb4d3-eb0f-4d0b-8b4c-fbeeabac56a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:52.716267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbb4d3-eb0f-4d0b-8b4c-fbeeabac56a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:52.716652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbb4d3-eb0f-4d0b-8b4c-fbeeabac56a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:52.717216 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbb4d3-eb0f-4d0b-8b4c-fbeeabac56a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:52.727981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbb4d3-eb0f-4d0b-8b4c-fbeeabac56a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:52.729669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbb4d3-eb0f-4d0b-8b4c-fbeeabac56a6 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:52.748813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1213/2408] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:02:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:02:53.473172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:02:53.480729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:53.510545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ad41b9-25a2-4996-aa11-bc998c2644c3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:02:53.529314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:02:53.529966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:53.530450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:53.530918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] PATH_INFO: `/v3/projects/6124bc03573041c6bf65d8b85a12a72c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:53.532920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=6124bc03573041c6bf65d8b85a12a72c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:02:53.536673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:02:53.658880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6124bc03573041c6bf65d8b85a12a72c', 'request_id': 'req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:53.684892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6124bc03573041c6bf65d8b85a12a72c', 'request_id': 'req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:53.703158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6124bc03573041c6bf65d8b85a12a72c', 'request_id': 'req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:53.748074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] The token cache is being invalidate because project 6124bc03573041c6bf65d8b85a12a72c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:02:53.748074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:53.748074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:02:53.748074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1196/2409] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:02:53 2022] DELETE /identity/v3/projects/6124bc03573041c6bf65d8b85a12a72c => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:02:54.365085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799816d-0339-43d8-ac1d-37733ca0005e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:02:54.368239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799816d-0339-43d8-ac1d-37733ca0005e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:02:54.368728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c799816d-0339-43d8-ac1d-37733ca0005e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:02:54.389673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c799816d-0339-43d8-ac1d-37733ca0005e None None] MFA Rules not processed for user `e517ccaa24ca47c4a390e1bd760564b2`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:02:54.391175 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c799816d-0339-43d8-ac1d-37733ca0005e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:02:54.473411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1214/2410] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:02:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:03.736323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:04.457958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=4,keystone:SELECT=64,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:05.291834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:05.294595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:05.469148 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b0ac31-c3ba-4c1d-bd7f-40a5202e47dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:05.474647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:05.475288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:05.475565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:05.475839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] PATH_INFO: `/v3/users/17b09aa543444ab39445c43df53d9afb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:05.477039 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=17b09aa543444ab39445c43df53d9afb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:05.479624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:05.540685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17b09aa543444ab39445c43df53d9afb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:05.540685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17b09aa543444ab39445c43df53d9afb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:05.556562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17b09aa543444ab39445c43df53d9afb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:05.578539 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17b09aa543444ab39445c43df53d9afb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:05.597994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17b09aa543444ab39445c43df53d9afb'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:05.608312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1197/2411] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:05 2022] DELETE /identity/v3/users/17b09aa543444ab39445c43df53d9afb => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:05.614342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:05.614857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:05.615032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:05.638597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:05.640268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:05.776646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1215/2412] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:05.782293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:05.783913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:05.876081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824b1e7-d296-4987-91b4-7f3e26b09da0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:05.880434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231e1230-0a7c-4914-b3e8-e44a09a9a2be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:05.881101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e1230-0a7c-4914-b3e8-e44a09a9a2be service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:05.881440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e1230-0a7c-4914-b3e8-e44a09a9a2be service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:05.881865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231e1230-0a7c-4914-b3e8-e44a09a9a2be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:05.896208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e1230-0a7c-4914-b3e8-e44a09a9a2be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:05.897705 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231e1230-0a7c-4914-b3e8-e44a09a9a2be service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:05.909217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1198/2413] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:06.327448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:06.329759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:06.349294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8513b5-773f-4e90-af9a-730a5fcefa5c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:06.356322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:06.357060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:06.357409 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:06.357746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] PATH_INFO: `/v3/projects/546d64aebf924d528dce2e1c621e854c` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:06.358975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=546d64aebf924d528dce2e1c621e854c)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:06.360993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:06.435985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '546d64aebf924d528dce2e1c621e854c', 'request_id': 'req-bcd290f6-483c-4b62-bce2-2500a06ea033'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:06.444226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '546d64aebf924d528dce2e1c621e854c', 'request_id': 'req-bcd290f6-483c-4b62-bce2-2500a06ea033'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:06.452739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '546d64aebf924d528dce2e1c621e854c', 'request_id': 'req-bcd290f6-483c-4b62-bce2-2500a06ea033'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:06.471037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] The token cache is being invalidate because project 546d64aebf924d528dce2e1c621e854c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:06.471037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:06.471037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bcd290f6-483c-4b62-bce2-2500a06ea033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:06.473201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1216/2414] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:06 2022] DELETE /identity/v3/projects/546d64aebf924d528dce2e1c621e854c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:06.746526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045803-ba2b-4cf0-9f7b-d3c9945445d3 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:06.747529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045803-ba2b-4cf0-9f7b-d3c9945445d3 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:06.747816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0045803-ba2b-4cf0-9f7b-d3c9945445d3 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:06.750084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1199/2415] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:03:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:06.757789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a354aa-5607-4983-8b86-f68e350b55dd None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:06.758361 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a354aa-5607-4983-8b86-f68e350b55dd None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:06.758477 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a354aa-5607-4983-8b86-f68e350b55dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:06.781956 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f3a354aa-5607-4983-8b86-f68e350b55dd None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:06.783210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f3a354aa-5607-4983-8b86-f68e350b55dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:06.876529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1217/2416] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:03:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:06.884236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045803-ba2b-4cf0-9f7b-d3c9945445d3 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:06.885947 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d0045803-ba2b-4cf0-9f7b-d3c9945445d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:06.913642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:06.949499 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0045803-ba2b-4cf0-9f7b-d3c9945445d3 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:06.952977 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff049d5a-0c90-47cd-814c-86c4bf3ba175 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:06.953577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049d5a-0c90-47cd-814c-86c4bf3ba175 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:06.953850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049d5a-0c90-47cd-814c-86c4bf3ba175 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:06.954118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff049d5a-0c90-47cd-814c-86c4bf3ba175 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:06.964274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff049d5a-0c90-47cd-814c-86c4bf3ba175 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:06.965679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff049d5a-0c90-47cd-814c-86c4bf3ba175 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:06.976278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1200/2417] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:07.045318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f534-19ee-48b9-af54-62e8221b872b None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.045601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f534-19ee-48b9-af54-62e8221b872b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.045888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d46f534-19ee-48b9-af54-62e8221b872b None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.047264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1218/2418] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:07.052623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c8cd-a039-4cb5-937e-e7e3c2888dbf None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.052909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c8cd-a039-4cb5-937e-e7e3c2888dbf None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.053186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a648c8cd-a039-4cb5-937e-e7e3c2888dbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.073299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a648c8cd-a039-4cb5-937e-e7e3c2888dbf None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:07.074478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a648c8cd-a039-4cb5-937e-e7e3c2888dbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:07.123871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1201/2419] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:03:07 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:07.136620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f534-19ee-48b9-af54-62e8221b872b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:07.138267 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0d46f534-19ee-48b9-af54-62e8221b872b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:07.152342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d46f534-19ee-48b9-af54-62e8221b872b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:07.155797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9fb2e5-6e44-4324-a7c9-80da8592efed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:07.156416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb2e5-6e44-4324-a7c9-80da8592efed service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.156693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb2e5-6e44-4324-a7c9-80da8592efed service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.156958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9fb2e5-6e44-4324-a7c9-80da8592efed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.163875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb2e5-6e44-4324-a7c9-80da8592efed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:07.165323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9fb2e5-6e44-4324-a7c9-80da8592efed service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:07.173214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1219/2420] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:07 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:07.255660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d9ad-5ae2-483d-aaa9-d4e631893bd7 None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.255876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d9ad-5ae2-483d-aaa9-d4e631893bd7 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.256186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5572d9ad-5ae2-483d-aaa9-d4e631893bd7 None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.257533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1202/2421] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:03:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:03:07.262404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc27d86-a778-4352-bb17-698fc2c887b0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.262686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc27d86-a778-4352-bb17-698fc2c887b0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.262958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc27d86-a778-4352-bb17-698fc2c887b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.270889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:07.285620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bdc27d86-a778-4352-bb17-698fc2c887b0 None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:07.286839 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bdc27d86-a778-4352-bb17-698fc2c887b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:07.296095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1220/2422] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:03:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:07.306981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572d9ad-5ae2-483d-aaa9-d4e631893bd7 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:07.318656 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5572d9ad-5ae2-483d-aaa9-d4e631893bd7 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:07.322238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:07.322829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:07.323110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:07.323383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:07.334013 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:07.335430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:07.346048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1203/2423] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:09.076441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b693-5b8e-46c8-b8b5-a1d9ee2549f5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:09.076949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b693-5b8e-46c8-b8b5-a1d9ee2549f5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:09.077065 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d47b693-5b8e-46c8-b8b5-a1d9ee2549f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:09.096612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2d47b693-5b8e-46c8-b8b5-a1d9ee2549f5 None None] MFA Rules not processed for user `67d1de462c2a40be909e32e1846d77ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:09.098643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2d47b693-5b8e-46c8-b8b5-a1d9ee2549f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:09.161959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1221/2424] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:09 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:10.032233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:10.042173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b1fbd3-59d3-447f-9c4e-bf028c7611eb service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:10.046368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:10.047069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:10.047513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:10.047954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:10.050428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:10.153453 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:10.155514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:10.172490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1204/2425] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:10 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:11.319397 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6383b-966b-410b-b097-7254f0019e9d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:11.319955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6383b-966b-410b-b097-7254f0019e9d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:11.319955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e6383b-966b-410b-b097-7254f0019e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:11.343368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-26e6383b-966b-410b-b097-7254f0019e9d None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:11.344837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-26e6383b-966b-410b-b097-7254f0019e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:11.415787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1222/2426] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:03:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:11.430480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:11.432247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:11.535040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:11.568675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ac7211-764b-4bc7-bf11-8760614898c7 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:11.588185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:11.589269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:11.589961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:11.590582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:11.604191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:11.606460 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:11.619463 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1205/2427] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:03:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:03:21.407788 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=52 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:21.614649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:31.662657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3996-a6c9-4e17-95ab-0b64b3f076ef None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:31.663568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3996-a6c9-4e17-95ab-0b64b3f076ef None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:31.664194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bb3996-a6c9-4e17-95ab-0b64b3f076ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:31.688786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-54bb3996-a6c9-4e17-95ab-0b64b3f076ef None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:31.691301 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-54bb3996-a6c9-4e17-95ab-0b64b3f076ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:31.700536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1223/2428] 10.222.0.72 () {58 vars in 967 bytes} [Thu Aug 25 03:03:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:31.723321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:31.733902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c27e05-af4a-476f-a064-49afcd3c57e8 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:31.739541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:31.740159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:31.741002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:31.741002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:31.750264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:31.752135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:31.762650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1206/2429] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:03:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:03:33.998618 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea08-cd1d-483d-8986-9315dbfa1ae0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:33.999118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea08-cd1d-483d-8986-9315dbfa1ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:33.999607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9472ea08-cd1d-483d-8986-9315dbfa1ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:34.025015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9472ea08-cd1d-483d-8986-9315dbfa1ae0 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:34.026204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9472ea08-cd1d-483d-8986-9315dbfa1ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:34.033510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1224/2430] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:03:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:34.045967 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:34.056669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c8d111-dd82-476b-ae60-7811876990df service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:34.061547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:34.062131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:34.062410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:34.062683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:34.070846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:34.072461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:34.080450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1207/2431] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:03:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:03:44.019382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:44.077308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=12 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:49.629076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:49.629650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:49.629842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:49.649704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:49.651032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:49.658220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1225/2432] 10.222.0.72 () {58 vars in 967 bytes} [Thu Aug 25 03:03:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:49.671530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:49.682361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec21cf-d0c3-41ae-a09e-b44c3e0af527 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:49.687427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:49.688117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:49.688486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:49.688822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:49.697397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:49.699041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:49.708114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1208/2433] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:03:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 03:03:51.611870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:51.615060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:51.683731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c64a205-5609-40de-a18f-e8fff6f83374 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:51.688211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:51.688854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:51.689130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:51.689403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] PATH_INFO: `/v3/users/e517ccaa24ca47c4a390e1bd760564b2` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:51.690559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e517ccaa24ca47c4a390e1bd760564b2)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:51.693082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:51.746211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e517ccaa24ca47c4a390e1bd760564b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.746869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e517ccaa24ca47c4a390e1bd760564b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.755666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e517ccaa24ca47c4a390e1bd760564b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.763703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e517ccaa24ca47c4a390e1bd760564b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.776954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-8e58c319-78da-4d80-b570-bbcf3e76f2e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e517ccaa24ca47c4a390e1bd760564b2'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:51.783089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1226/2434] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:03:51 2022] DELETE /identity/v3/users/e517ccaa24ca47c4a390e1bd760564b2 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:51.966404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:51.977811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151bf5d0-c915-4512-ae14-7d90308988f1 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.039145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.039771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.040051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.040361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] PATH_INFO: `/v3/projects/f6ce2ff6a1284fddbaf61fe3f47886fa` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.041467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ce2ff6a1284fddbaf61fe3f47886fa)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.043547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.097718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ce2ff6a1284fddbaf61fe3f47886fa', 'request_id': 'req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.103638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ce2ff6a1284fddbaf61fe3f47886fa', 'request_id': 'req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.110357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ce2ff6a1284fddbaf61fe3f47886fa', 'request_id': 'req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.123565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] The token cache is being invalidate because project f6ce2ff6a1284fddbaf61fe3f47886fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:03:52.123852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.124511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-eaeb0a18-2faa-45aa-9e5f-c6bd68e11160 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:03:52.126258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1209/2435] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:03:51 2022] DELETE /identity/v3/projects/f6ce2ff6a1284fddbaf61fe3f47886fa => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:52.131827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.132355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.132626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.156276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:52.156276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.214445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1227/2436] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:52.222700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.222986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.223260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.243172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:52.244416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.252545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1210/2437] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:52.256829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.266442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833beff8-d8f9-4dd3-a819-84692b600987 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.271033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.271620 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.271895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.272196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.272841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:03:52.273137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.274708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.283168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:52.287365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1228/2438] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:03:52.291616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.301576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4933d8e-6cb4-4c68-ba9f-dc811343248e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.306241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.306830 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.307107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.307376 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.307984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.309887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.337734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1211/2439] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:52.341944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.352262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05bf5c74-156c-48bc-ad77-16e6d5fde341 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.407646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.408208 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.408485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.408757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.409381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.411446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.431459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1229/2440] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:03:52.435674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.447231 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223a6d2-0ffa-476b-a1d7-8f53e5cd3bf5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.451829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.452454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.452734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.453004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.453644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.455215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.465736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1212/2441] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:52.469602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.479466 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc349c-ff58-40fc-8196-c13bd2d1284a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.484012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-614e820a-eebb-4ece-873c-9a947b37348c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.484641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e820a-eebb-4ece-873c-9a947b37348c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.484918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e820a-eebb-4ece-873c-9a947b37348c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.485188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-614e820a-eebb-4ece-873c-9a947b37348c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.485826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e820a-eebb-4ece-873c-9a947b37348c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.487410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-614e820a-eebb-4ece-873c-9a947b37348c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.497901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1230/2442] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:03:52.502000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.512623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685daeb6-c0b2-4e39-9063-b1797da14233 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.517121 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.517748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.518031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.518320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] PATH_INFO: `/v3/projects/1b3c2cddcd934193ab024fee91f4369c/users/f0ae76bf0956458bb0ccb374a6c2ea47/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.533096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b3c2cddcd934193ab024fee91f4369c, user_id=f0ae76bf0956458bb0ccb374a6c2ea47, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.535939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.548161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1213/2443] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:03:52 2022] PUT /identity/v3/projects/1b3c2cddcd934193ab024fee91f4369c/users/f0ae76bf0956458bb0ccb374a6c2ea47/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:03:52.553746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146311-9486-4433-ac92-6d381883c6f2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.554027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146311-9486-4433-ac92-6d381883c6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.554363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53146311-9486-4433-ac92-6d381883c6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.573966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-53146311-9486-4433-ac92-6d381883c6f2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:52.575165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-53146311-9486-4433-ac92-6d381883c6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.632991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1231/2444] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:52.642581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:52.644368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:52.658310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:03:52.701590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c773f1ab-ef83-46b4-a20f-c397460f5b0c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:52.705223 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:52.705817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:52.706093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:52.706590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:52.715361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:52.716804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:52.726258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1214/2445] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:53.470008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4cad4-c233-42a6-a2de-81f3d13f651b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:53.470445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4cad4-c233-42a6-a2de-81f3d13f651b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:53.470817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c4cad4-c233-42a6-a2de-81f3d13f651b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:53.501077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-12c4cad4-c233-42a6-a2de-81f3d13f651b None None] MFA Rules not processed for user `f0ae76bf0956458bb0ccb374a6c2ea47`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:53.502214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-12c4cad4-c233-42a6-a2de-81f3d13f651b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:53.568840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1232/2446] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:53 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:53.579607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:53.581092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:53.645382 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2488bb-cd8c-40c1-b476-108334f68981 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:53.649280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:53.649904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:53.650237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:53.650510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:53.659197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:53.661289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:53.670444 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1215/2447] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:03:55.078915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ff40-9692-4b3b-af5d-85bc8f85a2a6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:55.079486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ff40-9692-4b3b-af5d-85bc8f85a2a6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:55.079486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f864ff40-9692-4b3b-af5d-85bc8f85a2a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:55.099014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-f864ff40-9692-4b3b-af5d-85bc8f85a2a6 None None] MFA Rules not processed for user `f0ae76bf0956458bb0ccb374a6c2ea47`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:03:55.100231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f864ff40-9692-4b3b-af5d-85bc8f85a2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:55.106961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1233/2448] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:03:55 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:03:56.173936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:03:56.175399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:56.244282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5a7e93-d380-484a-95af-f3dc4f521e70 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:03:56.249400 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:03:56.250254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:03:56.250666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:03:56.250939 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:03:56.252654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:03:56.264557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:03:56.266119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:03:56.276581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1216/2449] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:03:56 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:05.093238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:06.272424 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=78 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:28.347524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a2ba1-20fb-437f-8f15-648a10e61b4b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:28.348026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a2ba1-20fb-437f-8f15-648a10e61b4b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:28.348368 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608a2ba1-20fb-437f-8f15-648a10e61b4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:28.369396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-608a2ba1-20fb-437f-8f15-648a10e61b4b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:28.370847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-608a2ba1-20fb-437f-8f15-648a10e61b4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:28.380281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1234/2450] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:04:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:04:28.404257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:28.406743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:28.501105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0617e858-ea9e-4df4-97dd-df8ef408aaf8 service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:28.520172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2552a917-4123-4124-a44a-395de454edfd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:28.520997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552a917-4123-4124-a44a-395de454edfd service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:28.521282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552a917-4123-4124-a44a-395de454edfd service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:28.521611 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2552a917-4123-4124-a44a-395de454edfd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:28.532298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552a917-4123-4124-a44a-395de454edfd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:28.534166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2552a917-4123-4124-a44a-395de454edfd service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:28.545845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1217/2451] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:30.362680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:30.363133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:30.363217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:30.385130 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] MFA Rules not processed for user `ce7b1f7925614a2b9cf9d2c7eaf2b7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:30.386702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:30.441129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1235/2452] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:04:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:31.389632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3351d48-9466-4365-81bb-7c74b03dde08 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:31.390107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3351d48-9466-4365-81bb-7c74b03dde08 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:31.390208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3351d48-9466-4365-81bb-7c74b03dde08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:31.410328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c3351d48-9466-4365-81bb-7c74b03dde08 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:31.411600 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3351d48-9466-4365-81bb-7c74b03dde08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:31.420802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1218/2453] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:04:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:31.442101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:31.455421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0078ce1-56b8-484b-aede-b010c207207a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:31.460915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:31.461641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:31.461988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:31.462327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:31.471108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:31.472821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:31.484104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1236/2454] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:36.739701 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b64ae-477c-4333-b353-6fb436470026 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:36.740265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b64ae-477c-4333-b353-6fb436470026 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:36.740265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3b64ae-477c-4333-b353-6fb436470026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:36.760355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-be3b64ae-477c-4333-b353-6fb436470026 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:36.761535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be3b64ae-477c-4333-b353-6fb436470026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:36.769976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1219/2455] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:04:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:36.792546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:36.803834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abdfd64-f8ba-4122-b1c2-c257048ee0c9 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:36.810115 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:36.810720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:36.811002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:36.811280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:36.819797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:36.821454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:36.831610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1237/2456] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:40.840590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5711ad-47a8-436a-8e50-6cb32e6ebf55 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:40.841192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5711ad-47a8-436a-8e50-6cb32e6ebf55 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:40.841192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5711ad-47a8-436a-8e50-6cb32e6ebf55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:40.862272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6e5711ad-47a8-436a-8e50-6cb32e6ebf55 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:40.863495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6e5711ad-47a8-436a-8e50-6cb32e6ebf55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:40.871784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1220/2457] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:04:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:40.895469 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:40.897005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:40.912661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1c1331-c57b-4c2a-85fc-1159e4417f1d service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:40.919234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:40.919859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:40.920160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:40.920435 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:40.929461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:40.931113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:40.946186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1238/2458] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:45.063762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b9116-95ec-497d-a801-1c3242b59c2b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:45.064362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b9116-95ec-497d-a801-1c3242b59c2b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:45.064468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110b9116-95ec-497d-a801-1c3242b59c2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:45.084312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-110b9116-95ec-497d-a801-1c3242b59c2b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:45.085576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-110b9116-95ec-497d-a801-1c3242b59c2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:45.094072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1221/2459] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:45.118775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:45.130638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5db69b-5f94-4aef-9f6b-ef241910d2cf service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:45.136424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:45.137029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:45.137306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:45.137583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:45.146501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:45.148218 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:45.158694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1239/2460] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:48.243734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576dbf-4afb-49da-af2c-9e505a8ba908 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:48.244786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576dbf-4afb-49da-af2c-9e505a8ba908 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:48.244884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd576dbf-4afb-49da-af2c-9e505a8ba908 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:48.265509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bd576dbf-4afb-49da-af2c-9e505a8ba908 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:04:48.266703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd576dbf-4afb-49da-af2c-9e505a8ba908 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:04:48.275152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1222/2461] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:04:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:04:48.298089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:04:48.309934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae98363-508d-4261-9d01-49bb05390e78 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:04:48.315331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2804431f-ccc3-4f79-b827-6433a5c88ab8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:04:48.315923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804431f-ccc3-4f79-b827-6433a5c88ab8 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:04:48.316360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804431f-ccc3-4f79-b827-6433a5c88ab8 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:04:48.316634 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2804431f-ccc3-4f79-b827-6433a5c88ab8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:04:48.325461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804431f-ccc3-4f79-b827-6433a5c88ab8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:04:48.327047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2804431f-ccc3-4f79-b827-6433a5c88ab8 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:04:48.336774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1240/2462] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:04:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:04:58.260703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=49 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:04:58.332312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=58 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:04.187513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd36c2-891b-4158-8d9d-0ee69684d9c4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:04.188185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd36c2-891b-4158-8d9d-0ee69684d9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:04.188185 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd36c2-891b-4158-8d9d-0ee69684d9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:04.208800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e6bd36c2-891b-4158-8d9d-0ee69684d9c4 None None] MFA Rules not processed for user `67d1de462c2a40be909e32e1846d77ca`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:04.209913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e6bd36c2-891b-4158-8d9d-0ee69684d9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:04.272599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1223/2463] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:05:04 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:06.850242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:06.850784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:06.850784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:06.871182 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] MFA Rules not processed for user `f0ae76bf0956458bb0ccb374a6c2ea47`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:06.872423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:06.879547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1241/2464] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:05:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:09.031905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:09.032366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:09.032483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:09.051884 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:09.053098 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:09.107818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1224/2465] 10.222.0.72 () {58 vars in 967 bytes} [Thu Aug 25 03:05:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:09.156113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:09.157610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:09.233650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b2e91a-44c4-4367-ae51-e9b5323dde70 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:09.239770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:09.240434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:09.240709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:09.240983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:09.254166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:09.255953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:09.266314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1242/2466] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:05:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:05:18.041274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:18.044159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:18.060262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17554088-fae8-4868-a644-abb8a8a77bc9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:18.065074 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:18.065715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:18.065989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:18.066255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] PATH_INFO: `/v3/users/213b3d0bd2714b13b344a16992196409` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:18.067402 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] RBAC: Authorizing `identity:delete_user(user_id=213b3d0bd2714b13b344a16992196409)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:18.069358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:18.121805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '213b3d0bd2714b13b344a16992196409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.122448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '213b3d0bd2714b13b344a16992196409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.134191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '213b3d0bd2714b13b344a16992196409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.141657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '213b3d0bd2714b13b344a16992196409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.148574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '213b3d0bd2714b13b344a16992196409'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.155258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1225/2467] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:18 2022] DELETE /identity/v3/users/213b3d0bd2714b13b344a16992196409 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:18.331030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:18.343105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6d83c5-2e5f-454e-93d4-7fb9fa9ef5df service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:18.400745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:18.401289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:18.401569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:18.401844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] PATH_INFO: `/v3/projects/523508b00e5f4544a0dbc6c8ad031602` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:18.403155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] RBAC: Authorizing `identity:delete_project(project_id=523508b00e5f4544a0dbc6c8ad031602)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:18.405118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:18.455524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '523508b00e5f4544a0dbc6c8ad031602', 'request_id': 'req-9024fbae-9c4d-4566-89a5-f2cafeac322e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.461559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '523508b00e5f4544a0dbc6c8ad031602', 'request_id': 'req-9024fbae-9c4d-4566-89a5-f2cafeac322e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.472713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '523508b00e5f4544a0dbc6c8ad031602', 'request_id': 'req-9024fbae-9c4d-4566-89a5-f2cafeac322e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.484899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] The token cache is being invalidate because project 523508b00e5f4544a0dbc6c8ad031602 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:18.485187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.485833 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.487369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1243/2468] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:18 2022] DELETE /identity/v3/projects/523508b00e5f4544a0dbc6c8ad031602 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:18.491297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:18.492841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:18.506328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e2caf9-fbe9-4c2d-bbe7-c9de01b6a46e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:18.527968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:18.570202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:18.570904 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:18.571187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:18.571456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] PATH_INFO: `/v3/users/c7415b01670942cea4a62d88edfd7222` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:18.573236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c7415b01670942cea4a62d88edfd7222)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:18.575124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:18.623618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c7415b01670942cea4a62d88edfd7222'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.624308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c7415b01670942cea4a62d88edfd7222'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.636944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c7415b01670942cea4a62d88edfd7222'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.644874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c7415b01670942cea4a62d88edfd7222'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.653151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bcd50312-8385-4006-9834-c375d9fb5244 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c7415b01670942cea4a62d88edfd7222'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:18.659105 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1226/2469] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:05:18 2022] DELETE /identity/v3/users/c7415b01670942cea4a62d88edfd7222 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:18.843211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:18.844726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:18.860237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9024fbae-9c4d-4566-89a5-f2cafeac322e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:18.869518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:18.926107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:18.927053 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:18.927337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:18.927613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] PATH_INFO: `/v3/projects/fc04d69da59f4a918f80a912d74e715f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:18.930362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc04d69da59f4a918f80a912d74e715f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:18.932354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:18.993558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc04d69da59f4a918f80a912d74e715f', 'request_id': 'req-cd081c9e-8c87-43eb-871c-9fc8905c80f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:19.000747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc04d69da59f4a918f80a912d74e715f', 'request_id': 'req-cd081c9e-8c87-43eb-871c-9fc8905c80f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:19.008558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc04d69da59f4a918f80a912d74e715f', 'request_id': 'req-cd081c9e-8c87-43eb-871c-9fc8905c80f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:19.021886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] The token cache is being invalidate because project fc04d69da59f4a918f80a912d74e715f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:05:19.022189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:19.022910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:05:19.024507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1244/2470] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:05:18 2022] DELETE /identity/v3/projects/fc04d69da59f4a918f80a912d74e715f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:05:24.836236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec37f-735d-4caf-b3b2-fcc7cb26ae97 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:24.836772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec37f-735d-4caf-b3b2-fcc7cb26ae97 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:24.836772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97ec37f-735d-4caf-b3b2-fcc7cb26ae97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:24.855689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a97ec37f-735d-4caf-b3b2-fcc7cb26ae97 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:24.856907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a97ec37f-735d-4caf-b3b2-fcc7cb26ae97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:24.922808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1227/2471] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:05:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:24.944371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:24.945847 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:25.018168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd081c9e-8c87-43eb-871c-9fc8905c80f7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:25.023511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:25.024135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:25.024416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:25.024687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:25.032846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:25.034427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:25.044215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1245/2472] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:28.102695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5e3f-ec4f-4a8d-8009-2508a6803f27 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:28.103220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5e3f-ec4f-4a8d-8009-2508a6803f27 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:28.103337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72a5e3f-ec4f-4a8d-8009-2508a6803f27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:28.123868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a72a5e3f-ec4f-4a8d-8009-2508a6803f27 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:28.125104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a72a5e3f-ec4f-4a8d-8009-2508a6803f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:28.132910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1228/2473] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:05:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:28.154325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:28.155715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:28.170705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd97050-d5fd-4983-9fab-433b01f79c46 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:28.176204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:28.176790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:28.177071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:28.177343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:28.186004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:28.187571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:28.197018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1246/2474] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:31.165081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387c74-2852-4886-ad99-6208971f53ac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:31.165632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387c74-2852-4886-ad99-6208971f53ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:31.165729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3387c74-2852-4886-ad99-6208971f53ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:31.190665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c3387c74-2852-4886-ad99-6208971f53ac None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:31.191867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c3387c74-2852-4886-ad99-6208971f53ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:31.200485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1229/2475] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:05:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:31.234363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:31.251129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3271ebb-9523-49d2-b003-8b5aa3b0f0c9 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:31.257845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:31.258441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:31.258718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:31.258989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:31.271388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:31.273063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:31.284726 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1247/2476] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:34.359586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:34.360168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:34.360168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:34.382877 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:34.384080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:34.391880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1230/2477] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:05:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:34.419177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:34.425065 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:34.432300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23616a0-80ce-41e9-8ab2-44b2cfa026f3 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:34.438697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:34.439284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:34.439560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:34.439830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:34.448851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:34.450591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:34.460167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1248/2478] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:36.529047 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.530558 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.557150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:36.590598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544ad6cc-dff1-47b0-baf3-2c8750809a8e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.594311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.594914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.595192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.595464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.597190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.610867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.612339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d04e65-274f-46c4-b9ca-7d90b14cea9b service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.623622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1231/2479] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:36.781697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:36.783094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.840982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66713e7c-9af7-4ec5-9003-cb4c6d95d69c service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:36.844670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:36.845281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:36.845578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:36.845834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:36.847603 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:36.861919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:36.863336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:36.874570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1249/2480] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:36 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:05:38.513154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.513632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.513743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.532379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:38.533556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:38.541220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1232/2481] 10.222.0.73 () {58 vars in 1016 bytes} [Thu Aug 25 03:05:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:38.565240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:38.576433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110aa449-76a9-49c6-bda6-14d839f98968 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:38.581836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:38.582420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:38.582698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:38.582971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:38.591138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:38.592764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:38.601899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1250/2482] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:46.255353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:46.268984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cab2ca3-17f6-41df-a7de-32349f521405 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:46.275258 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:46.275857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:46.276160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:46.276456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:46.278199 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:46.335614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:46.337361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d13faa-e52e-4552-87eb-5696fd26889f service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:46.347077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1233/2483] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:46 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:48.597792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=37 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:51.662308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:51.663844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.728999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615f5516-b136-4489-a1b5-4e93cad11fa3 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:51.732830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:51.733442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:51.733724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:51.733996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:51.736476 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:51.802549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:51.803990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:51.813740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1251/2484] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:51 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:54.272206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:54.272744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:54.272744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:54.292142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] MFA Rules not processed for user `31607fccfbaf44c9b0ce1f663a83f8a1`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:54.293275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:54.346053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1234/2485] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:05:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:54.885893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:54.896106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3d9bfa-5149-48d0-bfd5-d6de05ec1ca2 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:54.899692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:54.900329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:54.900635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:54.900907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:54.902613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:54.912896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:54.914330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b564b8ab-9a47-4d7f-86da-380b99a71df8 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:54.923883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1252/2486] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:55.284974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:55.286949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:55.385693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:05:55.391093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b7f8d0-3199-473c-83e1-da19a2e98efc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:55.404922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:55.405972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:55.406868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:55.407146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:55.409747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:55.423236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:55.424981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:55.438288 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1235/2487] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:55 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:05:57.839883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:57.840772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:57.841057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:57.863593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:05:57.865647 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:57.955255 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1253/2488] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:05:57 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:05:57.970470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:57.972282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:58.089572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df01b47-d033-4df3-a837-0a42a48a0d1e service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:58.096446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:58.098242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:58.098242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:58.098242 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:58.107930 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:58.109797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:58.119959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1236/2489] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:05:57 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:05:58.591506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:05:58.593189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:58.617228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddea97c-5dd7-4728-976b-7034655c8cd6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:05:58.649585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:05:58.650406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:05:58.650849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:05:58.657808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:05:58.662439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:05:58.690413 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:05:58.692972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:05:58.724152 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1254/2490] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:05:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:07.664302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:07.681159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd2b6-b5db-4fe5-ae99-9732a2722b0a service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:07.688572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:07.689417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:07.689851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:07.690307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:07.693081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:07.710208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:07.712085 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:07.728110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1237/2491] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:08.712972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:11.339877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:11.341523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:11.361329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ddaaccb-86ad-4ae8-a24e-1d604e1d84e8 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:11.366071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:11.366702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.366983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.367257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] PATH_INFO: `/v3/users/f0ae76bf0956458bb0ccb374a6c2ea47` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:11.368445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f0ae76bf0956458bb0ccb374a6c2ea47)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:11.370663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:11.420789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f0ae76bf0956458bb0ccb374a6c2ea47'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.422138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f0ae76bf0956458bb0ccb374a6c2ea47'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.430144 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f0ae76bf0956458bb0ccb374a6c2ea47'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.437932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f0ae76bf0956458bb0ccb374a6c2ea47'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.450462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b29a5f33-99f4-4dc5-bfba-5ea7d4549e07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f0ae76bf0956458bb0ccb374a6c2ea47'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.456830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1255/2492] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:11 2022] DELETE /identity/v3/users/f0ae76bf0956458bb0ccb374a6c2ea47 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:11.643502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:11.656406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361afbee-c9ff-4530-8a68-6300cf6045e9 service nova] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:11.728458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:11.729095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.729379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.729653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] PATH_INFO: `/v3/projects/1b3c2cddcd934193ab024fee91f4369c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:11.730828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b3c2cddcd934193ab024fee91f4369c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:11.732773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:11.783793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b3c2cddcd934193ab024fee91f4369c', 'request_id': 'req-285a7fca-b317-4646-8aab-8d9593699a99'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.789588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b3c2cddcd934193ab024fee91f4369c', 'request_id': 'req-285a7fca-b317-4646-8aab-8d9593699a99'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.796330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b3c2cddcd934193ab024fee91f4369c', 'request_id': 'req-285a7fca-b317-4646-8aab-8d9593699a99'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.805132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:11.811291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] The token cache is being invalidate because project 1b3c2cddcd934193ab024fee91f4369c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:11.812182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.812883 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-285a7fca-b317-4646-8aab-8d9593699a99 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:11.814566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1238/2493] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:11 2022] DELETE /identity/v3/projects/1b3c2cddcd934193ab024fee91f4369c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:11.819723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.820008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.820349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:11.840923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:11.842275 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:11.906273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1256/2494] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:11.913971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.914279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.914554 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:11.934513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:11.935636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:11.944370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1239/2495] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:11.948662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:11.959170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b3bf45-d782-4278-8cd0-5cb70a654663 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:11.963679 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:11.964305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.964583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.964940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:11.965499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:11.965798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:11.967382 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:11.979741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1257/2496] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:06:11.984275 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:11.993509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c16756-3d7f-4c5d-aa40-e06dffa97be2 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:11.998464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:11.999092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:11.999550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:11.999823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.000489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:12.002377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:12.032126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1240/2497] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:11 2022] POST /identity/v3/projects => generated 389 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:12.036193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:12.046527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8eb2ae-28ef-4471-bf6b-3a90fb2f5dcf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:12.110179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:12.110796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:12.111098 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:12.111503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.112180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:12.114087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:12.122450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:12.146777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1258/2498] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:12 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:12.147914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:12.160093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c633cb-c588-41e5-abef-9ef450e7fd9e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:12.166272 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:12.167239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:12.167819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:12.168277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.169073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:12.170821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:12.187802 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1241/2499] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:06:12.196399 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:12.208900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60942d76-846c-46c7-8dc4-f7130fecddfb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:12.214845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b41f56-28ab-4365-8583-70250afe1941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:12.215571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41f56-28ab-4365-8583-70250afe1941 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:12.216209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41f56-28ab-4365-8583-70250afe1941 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:12.216509 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b41f56-28ab-4365-8583-70250afe1941 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.217163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41f56-28ab-4365-8583-70250afe1941 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:12.219811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b41f56-28ab-4365-8583-70250afe1941 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:12.230791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1259/2500] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:12.237071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:12.247476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d11ebcc-c145-45ec-b898-ed4cf7e42e25 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:12.252918 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:12.253570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:12.253853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:12.254127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] PATH_INFO: `/v3/projects/1a9393082fc74f7ea1a43efd88af66df/users/5337155e04af4d9481d2b9d970d29818/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.270506 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1a9393082fc74f7ea1a43efd88af66df, user_id=5337155e04af4d9481d2b9d970d29818, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:12.273200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:12.286845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1242/2501] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:12 2022] PUT /identity/v3/projects/1a9393082fc74f7ea1a43efd88af66df/users/5337155e04af4d9481d2b9d970d29818/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:12.298227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:12.298564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:12.298842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.328374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] MFA Rules not processed for user `5337155e04af4d9481d2b9d970d29818`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:12.331484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:12.402357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1260/2502] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:12.414525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:12.416512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:12.487754 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e554430-9b07-47fd-b7a9-d866f0745095 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:12.491322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:12.491922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:12.492233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:12.492523 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:12.502588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:12.505378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:12.531358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1243/2503] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:12 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:15.500035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:15.501499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:15.557593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896948d6-4e80-4e63-a4d5-4c127c239cb0 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:15.561127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:15.561822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:15.562100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:15.562366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:15.564121 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:15.626720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:15.628215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:15.638097 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1261/2504] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:19.289256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:19.290899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.306073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9714114-8106-447e-bbef-ca46cf5fbd3d service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:19.310555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:19.311221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.311752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.312119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] PATH_INFO: `/v3/users/67d1de462c2a40be909e32e1846d77ca` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.313307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=67d1de462c2a40be909e32e1846d77ca)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:19.315237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:19.368834 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '67d1de462c2a40be909e32e1846d77ca'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.369522 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '67d1de462c2a40be909e32e1846d77ca'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.382981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '67d1de462c2a40be909e32e1846d77ca'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.391577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '67d1de462c2a40be909e32e1846d77ca'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.406477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-deb828ea-2884-4b23-9ef5-bc8d7f192a24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '67d1de462c2a40be909e32e1846d77ca'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.413029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1244/2505] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:19 2022] DELETE /identity/v3/users/67d1de462c2a40be909e32e1846d77ca => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:19.604167 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:19.614644 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eca4eb-418f-4463-b8eb-94ed9a34e17d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:19.633501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.633696 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:19.634125 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.634560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.656014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:19.657274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.661974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:19.684617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:19.685274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.685554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.685827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] PATH_INFO: `/v3/projects/c38e2834ce6f4835a53d1f099307d36d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.687708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c38e2834ce6f4835a53d1f099307d36d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:19.689804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:19.720254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1245/2506] 10.222.0.72 () {58 vars in 1009 bytes} [Thu Aug 25 03:06:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:19.733528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:19.734994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.743557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c38e2834ce6f4835a53d1f099307d36d', 'request_id': 'req-c5deff3c-77c1-45ec-9a62-a0ac723405f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.750391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c38e2834ce6f4835a53d1f099307d36d', 'request_id': 'req-c5deff3c-77c1-45ec-9a62-a0ac723405f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.758724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c38e2834ce6f4835a53d1f099307d36d', 'request_id': 'req-c5deff3c-77c1-45ec-9a62-a0ac723405f6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.772669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] The token cache is being invalidate because project c38e2834ce6f4835a53d1f099307d36d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:19.772979 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.773702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-c5deff3c-77c1-45ec-9a62-a0ac723405f6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:19.775327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1262/2507] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:19 2022] DELETE /identity/v3/projects/c38e2834ce6f4835a53d1f099307d36d => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:19.781628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618f601-073c-4229-949c-6861b4bd5748 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.781894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618f601-073c-4229-949c-6861b4bd5748 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.782224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3618f601-073c-4229-949c-6861b4bd5748 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.803545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-3618f601-073c-4229-949c-6861b4bd5748 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:19.804937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3618f601-073c-4229-949c-6861b4bd5748 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.806941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5853a0-24ef-4282-b18b-42635913fee0 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:19.865259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1263/2508] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:19.867227 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:19.867843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.868160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.868438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.870208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.873135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.873422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.874217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.894482 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:19.895701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:19.903683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1264/2509] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:19.907928 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:19.916878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667c6c32-a00a-4779-b81a-68a70adc1aa1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:19.922225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:19.922820 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.923100 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.923373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.924016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:19.924357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:19.925955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:19.935274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:19.937542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:19.942572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1265/2510] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:06:19.943513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:19.944398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:19.952922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1246/2511] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:06:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 25 03:06:19.955347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ed4ef0-4d9c-4b3a-b1c1-699e449794e4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:19.960433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:19.961034 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:19.961314 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:19.961588 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:19.962547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:19.964133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:19.994061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1266/2512] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:19 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:20.000573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:20.025368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bab7d8b-4242-405b-a851-88cc2eee0569 service swift] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:20.169141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:20.169712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.169989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.170263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.171430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:20.173743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:20.201298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1247/2513] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:19 2022] POST /identity/v3/users => generated 286 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:20.206174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:20.221489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2eae272-2c91-4bcb-8ddf-c7e63b5311b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:20.237407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:20.238014 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.238370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.238889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.239564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:20.241194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:20.242855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:20.288690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1267/2514] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:20.288968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:20.300443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25cce1f-1e28-4e2f-a2bf-332272c6865a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:20.305706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb09da8-7f8d-4cb2-ad9a-1667547f4631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:20.306320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb09da8-7f8d-4cb2-ad9a-1667547f4631 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.306609 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb09da8-7f8d-4cb2-ad9a-1667547f4631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.307015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb09da8-7f8d-4cb2-ad9a-1667547f4631 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.307719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb09da8-7f8d-4cb2-ad9a-1667547f4631 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:20.309511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccb09da8-7f8d-4cb2-ad9a-1667547f4631 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:20.322685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1248/2515] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:20 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:20.327906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:20.343347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4fb2594-c4d0-41b4-a012-6ff1b89e7693 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:20.349592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:20.350460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.350750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.351022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] PATH_INFO: `/v3/projects/3e0e470ba6554e26a4ddf9c6b1cfda16/users/1ec0f01ddbed45ca94b4af3d464a216b/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.383073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3e0e470ba6554e26a4ddf9c6b1cfda16, user_id=1ec0f01ddbed45ca94b4af3d464a216b, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:20.385786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:20.403912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1268/2516] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:20 2022] PUT /identity/v3/projects/3e0e470ba6554e26a4ddf9c6b1cfda16/users/1ec0f01ddbed45ca94b4af3d464a216b/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:20.414908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.415412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.415665 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.457603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] MFA Rules not processed for user `1ec0f01ddbed45ca94b4af3d464a216b`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:20.459793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:20.544962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1249/2517] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:20.558394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:20.561853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:20.659800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78f8a45-2c5a-4c69-9982-20be7ea9be5b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:20.667912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeedf7fb-0887-441a-bd72-1e9eb7c8aabb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:20.668575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedf7fb-0887-441a-bd72-1e9eb7c8aabb service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:20.668855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedf7fb-0887-441a-bd72-1e9eb7c8aabb service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:20.669129 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeedf7fb-0887-441a-bd72-1e9eb7c8aabb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:20.678669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedf7fb-0887-441a-bd72-1e9eb7c8aabb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:20.680304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeedf7fb-0887-441a-bd72-1e9eb7c8aabb service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:20.699764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1269/2518] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:20 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:22.863228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:22.864709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:22.933046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a8f183-cda6-45bb-a619-8cbd82bc061f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:22.938368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:22.938998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:22.939276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:22.939548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] PATH_INFO: `/v3/users/5337155e04af4d9481d2b9d970d29818` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:22.940719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5337155e04af4d9481d2b9d970d29818)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:22.942594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:22.952488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:22.995413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5337155e04af4d9481d2b9d970d29818'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:22.995993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5337155e04af4d9481d2b9d970d29818'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.009080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5337155e04af4d9481d2b9d970d29818'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.016171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5337155e04af4d9481d2b9d970d29818'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.023058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5337155e04af4d9481d2b9d970d29818'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.030464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1250/2519] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:22 2022] DELETE /identity/v3/users/5337155e04af4d9481d2b9d970d29818 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:23.034965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:23.035423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:23.035547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:23.054393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:23.055591 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:23.115260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1270/2520] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:23.126055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:23.127512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:23.188413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4601a8-fbbc-4497-afcc-20d3db5d369c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:23.192283 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:23.192737 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:23.193017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:23.193292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:23.202867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:23.204335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:23.214497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1251/2521] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:23.505196 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:23.506609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:23.518677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089ecaf7-ce05-4100-a4e2-ba04f81b8839 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:23.523206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:23.523840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:23.524224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:23.524505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] PATH_INFO: `/v3/projects/1a9393082fc74f7ea1a43efd88af66df` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:23.526032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1a9393082fc74f7ea1a43efd88af66df)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:23.527621 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:23.575565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1a9393082fc74f7ea1a43efd88af66df', 'request_id': 'req-aff6ab26-5c26-475f-b6ca-e174fc127410'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.577735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:23.582183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1a9393082fc74f7ea1a43efd88af66df', 'request_id': 'req-aff6ab26-5c26-475f-b6ca-e174fc127410'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.591322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1a9393082fc74f7ea1a43efd88af66df', 'request_id': 'req-aff6ab26-5c26-475f-b6ca-e174fc127410'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.603935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] The token cache is being invalidate because project 1a9393082fc74f7ea1a43efd88af66df was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:23.604259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.604932 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-aff6ab26-5c26-475f-b6ca-e174fc127410 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:23.606427 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1271/2522] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:23 2022] DELETE /identity/v3/projects/1a9393082fc74f7ea1a43efd88af66df => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:23.849494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:23.849494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:23.862494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92774181-1662-4ccb-9b67-5312104bb3ad service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:23.920513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:23.921762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:23.922222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:23.922651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] PATH_INFO: `/v3/users/1ec0f01ddbed45ca94b4af3d464a216b` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:23.924007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ec0f01ddbed45ca94b4af3d464a216b)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:23.926112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:23.982096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:24.000711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ec0f01ddbed45ca94b4af3d464a216b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.001574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ec0f01ddbed45ca94b4af3d464a216b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.015508 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ec0f01ddbed45ca94b4af3d464a216b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.025119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ec0f01ddbed45ca94b4af3d464a216b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.036607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ec0f01ddbed45ca94b4af3d464a216b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.044747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1252/2523] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:23 2022] DELETE /identity/v3/users/1ec0f01ddbed45ca94b4af3d464a216b => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:24.049316 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.049819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.050112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.070954 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:24.072120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.132494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1272/2524] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:24.143438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.145446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.243526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a25c73c-3c3d-4521-bec2-99f595923ea0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.248428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c43fc9b1-a8db-4a38-b1cc-b2bd405c939e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.250058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc9b1-a8db-4a38-b1cc-b2bd405c939e service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.250664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc9b1-a8db-4a38-b1cc-b2bd405c939e service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.251118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c43fc9b1-a8db-4a38-b1cc-b2bd405c939e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.262130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fc9b1-a8db-4a38-b1cc-b2bd405c939e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.263551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c43fc9b1-a8db-4a38-b1cc-b2bd405c939e service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.273907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1253/2525] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:24.579391 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.580853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.596090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cfe1b6-b822-4e72-8fba-46041cd506c3 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.600550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.601185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.602126 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.602762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] PATH_INFO: `/v3/projects/3e0e470ba6554e26a4ddf9c6b1cfda16` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.603972 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] RBAC: Authorizing `identity:delete_project(project_id=3e0e470ba6554e26a4ddf9c6b1cfda16)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.605829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.653457 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3e0e470ba6554e26a4ddf9c6b1cfda16', 'request_id': 'req-2e23e27e-ffd8-4111-9245-7429d2212ece'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.661369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3e0e470ba6554e26a4ddf9c6b1cfda16', 'request_id': 'req-2e23e27e-ffd8-4111-9245-7429d2212ece'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.670486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3e0e470ba6554e26a4ddf9c6b1cfda16', 'request_id': 'req-2e23e27e-ffd8-4111-9245-7429d2212ece'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.682760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] The token cache is being invalidate because project 3e0e470ba6554e26a4ddf9c6b1cfda16 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:24.683046 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.683665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2e23e27e-ffd8-4111-9245-7429d2212ece admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:24.685268 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1273/2526] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:24 2022] DELETE /identity/v3/projects/3e0e470ba6554e26a4ddf9c6b1cfda16 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:24.690130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.690421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.690725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.710321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:24.711529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.800682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1254/2527] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:24.807874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.808200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.808452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.831274 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:24.832519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:24.840707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1274/2528] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:24.845046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.855232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a104e515-663c-4fe5-8486-581b1def2794 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.860759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.861374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.861648 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.861920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.862566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:24.862865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.864484 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.877235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1255/2529] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:06:24.881593 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.891669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f24400b-f858-410c-9455-119d7be1e68b None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:24.896663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:24.897262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:24.897535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:24.897806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:24.898424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:24.900422 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:24.928981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1275/2530] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:24.933161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:24.945379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71af88c-ed27-46b2-999c-5aa404ed7d42 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.013261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:25.059224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.060421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.062433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.062953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.064315 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.067576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.092320 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1256/2531] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:24 2022] POST /identity/v3/users => generated 303 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:25.096303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.108166 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d46fe-2e6d-4995-bdc9-65b80c416505 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.113070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.113843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.114294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.114575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.115229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.121403 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.145230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1276/2532] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:25.149403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.168072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7571e61-ec0a-4900-af54-d0854a26cf39 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.175348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddc237-b390-4d27-851c-57bf10f9a5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.176263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddc237-b390-4d27-851c-57bf10f9a5d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.176549 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddc237-b390-4d27-851c-57bf10f9a5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.176821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddc237-b390-4d27-851c-57bf10f9a5d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.177472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddc237-b390-4d27-851c-57bf10f9a5d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.179091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddc237-b390-4d27-851c-57bf10f9a5d2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.195718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1257/2533] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:25.196609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.208282 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99122600-d0cf-4953-bec2-23452e04631e admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.213305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.214184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.214660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.215242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] PATH_INFO: `/v3/projects/92998b524cb54d859b8af232290ebff1/users/b3aa296fdd644c448534637c8e0ab246/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.232032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] RBAC: Authorizing `identity:create_grant(project_id=92998b524cb54d859b8af232290ebff1, user_id=b3aa296fdd644c448534637c8e0ab246, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.234979 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.246740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:25.254010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1277/2534] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:25 2022] PUT /identity/v3/projects/92998b524cb54d859b8af232290ebff1/users/b3aa296fdd644c448534637c8e0ab246/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:25.259472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d6d85-96a2-4485-9049-d258122a5f63 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.259765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d6d85-96a2-4485-9049-d258122a5f63 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.260134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d6d85-96a2-4485-9049-d258122a5f63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.279501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-be6d6d85-96a2-4485-9049-d258122a5f63 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:25.281660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be6d6d85-96a2-4485-9049-d258122a5f63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:25.341868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1258/2535] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:25.352013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:25.353722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:25.429869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004571d2-e934-4135-8a10-8c2f02ba95de admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:25.433811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:25.434770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:25.435259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:25.435673 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:25.449069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:25.450680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:25.462916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1278/2536] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:26.195138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.195734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.195734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.233903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] MFA Rules not processed for user `b3aa296fdd644c448534637c8e0ab246`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:26.235267 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:26.327811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1259/2537] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:26 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:26.328402 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:26.352388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7363c4f-32ce-46b2-9dfb-35c9b2970137 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:26.360571 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:26.361250 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.361549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.361829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.362567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:26.364767 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:26.405807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1279/2538] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:26 2022] POST /identity/v3/projects => generated 405 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:26.409679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:26.422028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a34304-7d92-40b4-8564-aab51b514f94 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:26.487168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:26.503419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:26.504274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.504565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.504829 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.505518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:26.507525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:26.535813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1260/2539] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:26 2022] POST /identity/v3/users => generated 309 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:26.539761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:26.550892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0266edd-b815-4849-8271-9a5a706ba7eb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:26.555352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:26.555949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.556254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.556525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.557157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:26.558764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:26.569277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1280/2540] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:26.573260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:26.583527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0cb032-a1db-44d4-a975-ba1873c86b06 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:26.588280 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:26.588921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.589203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.589480 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] PATH_INFO: `/v3/projects/79cf427c0bc64ba989d5f370481042f8/users/4dcc97b4e06b464aa36967da0b2cae16/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.604439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cf427c0bc64ba989d5f370481042f8, user_id=4dcc97b4e06b464aa36967da0b2cae16, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:26.607237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:26.621005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1261/2541] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:26 2022] PUT /identity/v3/projects/79cf427c0bc64ba989d5f370481042f8/users/4dcc97b4e06b464aa36967da0b2cae16/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:26.625480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:26.635775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-868b0318-7bb8-49bd-87b9-0f2fc5298fed admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:26.697688 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80e58e4-9f3c-44f7-99b9-8189c3b25559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:26.698353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e58e4-9f3c-44f7-99b9-8189c3b25559 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.698636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e58e4-9f3c-44f7-99b9-8189c3b25559 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.699120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80e58e4-9f3c-44f7-99b9-8189c3b25559 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.699821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e58e4-9f3c-44f7-99b9-8189c3b25559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:26.702089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80e58e4-9f3c-44f7-99b9-8189c3b25559 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:26.714739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1281/2542] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:26 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:26.718518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:26.730191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81b3d94d-2d10-488e-a441-b54f576cbd07 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:26.735404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:26.736087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:26.736596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:26.736929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] PATH_INFO: `/v3/projects/79cf427c0bc64ba989d5f370481042f8/users/4dcc97b4e06b464aa36967da0b2cae16/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:26.738998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79cf427c0bc64ba989d5f370481042f8, user_id=4dcc97b4e06b464aa36967da0b2cae16, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:26.741592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:26.753999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1262/2543] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:26 2022] PUT /identity/v3/projects/79cf427c0bc64ba989d5f370481042f8/users/4dcc97b4e06b464aa36967da0b2cae16/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:27.509806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:27.516370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:27.517305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:27.570173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] MFA Rules not processed for user `4dcc97b4e06b464aa36967da0b2cae16`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:27.572871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:27.664710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:27.687374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1282/2544] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:27 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:28.862770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:28.932619 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ca893-689c-4139-8001-ba59a16c2292 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:28.952254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:28.952254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:28.952254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:28.952254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] PATH_INFO: `/v3/users/b3aa296fdd644c448534637c8e0ab246` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:28.953237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3aa296fdd644c448534637c8e0ab246)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:28.953237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:28.989540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3aa296fdd644c448534637c8e0ab246'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:28.990197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3aa296fdd644c448534637c8e0ab246'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.002579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3aa296fdd644c448534637c8e0ab246'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.009901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3aa296fdd644c448534637c8e0ab246'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.017375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3aa296fdd644c448534637c8e0ab246'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.023136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1263/2545] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:28 2022] DELETE /identity/v3/users/b3aa296fdd644c448534637c8e0ab246 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:29.223606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:29.240338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6137436-8f7c-4179-9120-3fe761540568 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:29.315008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:29.316190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:29.316751 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:29.317172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] PATH_INFO: `/v3/projects/92998b524cb54d859b8af232290ebff1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:29.318761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] RBAC: Authorizing `identity:delete_project(project_id=92998b524cb54d859b8af232290ebff1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:29.321091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:29.373911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92998b524cb54d859b8af232290ebff1', 'request_id': 'req-51046c33-0883-42cc-a36f-cae3b755996c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.379400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92998b524cb54d859b8af232290ebff1', 'request_id': 'req-51046c33-0883-42cc-a36f-cae3b755996c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.386690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92998b524cb54d859b8af232290ebff1', 'request_id': 'req-51046c33-0883-42cc-a36f-cae3b755996c'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.398597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] The token cache is being invalidate because project 92998b524cb54d859b8af232290ebff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:29.398962 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.399694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.401273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1283/2546] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:29 2022] DELETE /identity/v3/projects/92998b524cb54d859b8af232290ebff1 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:29.406692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:29.408503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:29.422189 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2ba17c-764f-4f98-ba7f-9dab450713cd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:29.434815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:INSERT=6,keystone:DELETE=10 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:29.493908 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:29.494568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:29.494921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:29.495264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] PATH_INFO: `/v3/users/4dcc97b4e06b464aa36967da0b2cae16` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:29.496799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4dcc97b4e06b464aa36967da0b2cae16)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:29.499717 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:29.553548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4dcc97b4e06b464aa36967da0b2cae16'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.554325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4dcc97b4e06b464aa36967da0b2cae16'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.570685 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4dcc97b4e06b464aa36967da0b2cae16'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.589581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4dcc97b4e06b464aa36967da0b2cae16'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.599166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-4cec35df-4ac5-4551-8c0a-e8a0715f4ff3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4dcc97b4e06b464aa36967da0b2cae16'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.605409 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1264/2547] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:29 2022] DELETE /identity/v3/users/4dcc97b4e06b464aa36967da0b2cae16 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:29.792464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:29.794038 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:29.810145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51046c33-0883-42cc-a36f-cae3b755996c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:29.867722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:29.868388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:29.868762 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:29.868940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] PATH_INFO: `/v3/projects/79cf427c0bc64ba989d5f370481042f8` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:29.870061 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=79cf427c0bc64ba989d5f370481042f8)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:29.872264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:29.911102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:29.944117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79cf427c0bc64ba989d5f370481042f8', 'request_id': 'req-9761a3d9-0c31-42fd-a640-368df916ddfe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.950340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79cf427c0bc64ba989d5f370481042f8', 'request_id': 'req-9761a3d9-0c31-42fd-a640-368df916ddfe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.965663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79cf427c0bc64ba989d5f370481042f8', 'request_id': 'req-9761a3d9-0c31-42fd-a640-368df916ddfe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.983660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] The token cache is being invalidate because project 79cf427c0bc64ba989d5f370481042f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:29.983950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.984744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9761a3d9-0c31-42fd-a640-368df916ddfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:29.986441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1284/2548] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:29 2022] DELETE /identity/v3/projects/79cf427c0bc64ba989d5f370481042f8 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:29.991316 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:29.991827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:29.991937 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.045438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:30.047075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:30.176907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1265/2549] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:30.184715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.185117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.185257 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.209090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:30.210294 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:30.218319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1285/2550] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:30.222728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.232772 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da3e0cf-c61b-4470-ba58-fd00eda658de None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.241429 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.242423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.242423 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.242614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.243236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:30.243541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.245406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.259092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1266/2551] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:06:30.263544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.275848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1737de82-cd81-4857-8239-1c1f91be8fb5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.286320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.286949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.287444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.287799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.288630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.290920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.328544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1286/2552] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:30 2022] POST /identity/v3/projects => generated 363 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:30.329379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.339753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e3f135-051c-4852-a287-966c82d2bca3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.361228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:30.403322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.403928 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.404247 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.404660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.405201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.407115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.433842 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1267/2553] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:30 2022] POST /identity/v3/users => generated 282 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:30.438756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.449512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25575c6a-becd-4d50-80b3-d4d9528defa5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.455027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.455633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.455914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.456221 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.456874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.458500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.468458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1287/2554] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:30.472443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.482389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10e7213-ce03-488c-b5fe-42ade1cf5819 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.488282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f4c37b-c79a-4a94-9994-b50b2082eb3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.488879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c37b-c79a-4a94-9994-b50b2082eb3e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.489159 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c37b-c79a-4a94-9994-b50b2082eb3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.489430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f4c37b-c79a-4a94-9994-b50b2082eb3e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.490070 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c37b-c79a-4a94-9994-b50b2082eb3e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.491807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f4c37b-c79a-4a94-9994-b50b2082eb3e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.505396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1268/2555] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:30.508151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.518092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ffdd4-d86f-482a-8aee-719ad819171d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.522639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.523278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.523559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.523829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] PATH_INFO: `/v3/projects/97944dd7a73549cbb901d3c6cdf44e0f/users/b862796f9b874278935608d1d2149be6/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.538348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] RBAC: Authorizing `identity:create_grant(project_id=97944dd7a73549cbb901d3c6cdf44e0f, user_id=b862796f9b874278935608d1d2149be6, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.541033 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.554111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1288/2556] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:30 2022] PUT /identity/v3/projects/97944dd7a73549cbb901d3c6cdf44e0f/users/b862796f9b874278935608d1d2149be6/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:30.564906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.565192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.565469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.595348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] MFA Rules not processed for user `b862796f9b874278935608d1d2149be6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:30.596587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:30.659723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1269/2557] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:30.664336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.753149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfe62c2-41e9-4fd9-95c5-d8b8a0879dfe admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.758286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.758905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.759181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.759541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.760214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.762123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.796088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1289/2558] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:30 2022] POST /identity/v3/projects => generated 365 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:30.798533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.809147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c363d52-2ab0-44eb-8549-8ebd64278ec4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.866533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.867058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.867338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.867612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.868290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.870238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.892553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1270/2559] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:30 2022] POST /identity/v3/users => generated 289 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:30.896642 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.907522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b8ba6c-dd87-43e6-bf94-6da7ca1c3606 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.912183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.912786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.913067 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.913341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.913982 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.915585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.926174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1290/2560] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:30.930330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.940851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4bca6-a78d-4417-be45-9df148d410f1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:30.945457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:30.946104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:30.946383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:30.946676 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] PATH_INFO: `/v3/projects/b0340266835a4c2f8a0fa4e9c71d82d0/users/da190bbba11f4284a97677db2d7d7938/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:30.962698 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0340266835a4c2f8a0fa4e9c71d82d0, user_id=da190bbba11f4284a97677db2d7d7938, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:30.965383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:30.973608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:30.979839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1271/2561] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:30 2022] PUT /identity/v3/projects/b0340266835a4c2f8a0fa4e9c71d82d0/users/da190bbba11f4284a97677db2d7d7938/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:30.983785 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:30.993770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e943b41-15fa-4ec4-85dd-f753fd9b0798 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:31.012690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:31.052362 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aaa9c-bef6-4ece-bf00-c03dd7ba53bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:31.052964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aaa9c-bef6-4ece-bf00-c03dd7ba53bd admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.053245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aaa9c-bef6-4ece-bf00-c03dd7ba53bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.053518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aaa9c-bef6-4ece-bf00-c03dd7ba53bd admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.054164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aaa9c-bef6-4ece-bf00-c03dd7ba53bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:31.055755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00aaa9c-bef6-4ece-bf00-c03dd7ba53bd admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:31.066650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1291/2562] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:30 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:31.071127 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:31.084599 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1970e6e3-6bb3-4dea-81c1-a7e439918eb3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:31.096720 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:31.097984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.098470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.098994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] PATH_INFO: `/v3/projects/b0340266835a4c2f8a0fa4e9c71d82d0/users/da190bbba11f4284a97677db2d7d7938/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.103072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0340266835a4c2f8a0fa4e9c71d82d0, user_id=da190bbba11f4284a97677db2d7d7938, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:31.108604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:31.134419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1272/2563] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:31 2022] PUT /identity/v3/projects/b0340266835a4c2f8a0fa4e9c71d82d0/users/da190bbba11f4284a97677db2d7d7938/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:31.136521 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.136808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.137077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.171489 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] MFA Rules not processed for user `da190bbba11f4284a97677db2d7d7938`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:31.172733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:31.257272 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1292/2564] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:31.265476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:31.267271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:31.363583 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06bd092-ab8a-4dc2-985b-8f33f5a9629c admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:31.367322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:31.367944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.368251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.368521 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.380555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:31.382034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:31.393567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1273/2565] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:31 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:31.473587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:31.483333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9572c3fb-3a4a-4d27-87f3-77a756fc3b90 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:31.486943 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:31.487538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:31.487882 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:31.488194 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:31.553711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:31.555153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:31.564497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1293/2566] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:31 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:37.333282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:37.335069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:37.445243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d86c71-9dcf-46ff-8045-d1a9e8947a2c service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:37.451858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:37.452586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:37.453487 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:37.453794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:37.455679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:37.468117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:37.471147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef0760d-4e53-4a5d-95d9-f72b7399514f service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:37.483029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1274/2567] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:37 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:38.654722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:38.698844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:38.716271 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d11efdb-4c54-4164-9fd2-6ce3254ee7d1 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:38.721320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:38.721939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:38.722217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:38.722496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] PATH_INFO: `/v3/users/b862796f9b874278935608d1d2149be6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:38.723628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b862796f9b874278935608d1d2149be6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:38.725564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:38.770405 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b862796f9b874278935608d1d2149be6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:38.771047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b862796f9b874278935608d1d2149be6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:38.778231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b862796f9b874278935608d1d2149be6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:38.785821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b862796f9b874278935608d1d2149be6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:38.798240 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b862796f9b874278935608d1d2149be6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:38.804112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1294/2568] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:38 2022] DELETE /identity/v3/users/b862796f9b874278935608d1d2149be6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:38.808556 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac12d4-122b-4f20-a612-8f92a64c18c5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:38.809029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac12d4-122b-4f20-a612-8f92a64c18c5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:38.809135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ac12d4-122b-4f20-a612-8f92a64c18c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:38.827513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d4ac12d4-122b-4f20-a612-8f92a64c18c5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:38.829014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4ac12d4-122b-4f20-a612-8f92a64c18c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:38.885903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1275/2569] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:38.895811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:38.897227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:38.942378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:38.942662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:38.942940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:38.962021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] MFA Rules not processed for user `2305c248866447d6a85fe63385ee12a5`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:38.963213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:38.966157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2844d439-d6b8-42ee-9902-0dda9502b0f8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:38.970667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:38.971273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:38.971545 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:38.971818 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:38.972652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:38.983724 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:38.985937 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:38.996366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1295/2570] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:39.023171 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1276/2571] 10.222.0.72 () {58 vars in 967 bytes} [Thu Aug 25 03:06:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:39.036386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:39.037812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:39.113732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6fa4d2-73f3-4201-9593-5c30515883b7 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:39.118801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bb3a4609c413473ebfdda8bddedc631c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:39.119539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:39.119831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:39.120133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:39.126101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:39.131262 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:39.133228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:39.145070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1296/2572] 10.222.0.72 () {60 vars in 1384 bytes} [Thu Aug 25 03:06:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 25 03:06:39.277378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:39.278894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:39.301779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73945bde-e0b5-4bd1-91c1-233e46d20e42 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:39.313155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:39.314103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:39.314416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:39.314695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] PATH_INFO: `/v3/projects/97944dd7a73549cbb901d3c6cdf44e0f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:39.316192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97944dd7a73549cbb901d3c6cdf44e0f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:39.318243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:39.369614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97944dd7a73549cbb901d3c6cdf44e0f', 'request_id': 'req-61a588fd-01d6-48ba-9ae7-e661ddcda435'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.377015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97944dd7a73549cbb901d3c6cdf44e0f', 'request_id': 'req-61a588fd-01d6-48ba-9ae7-e661ddcda435'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.386810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97944dd7a73549cbb901d3c6cdf44e0f', 'request_id': 'req-61a588fd-01d6-48ba-9ae7-e661ddcda435'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.409528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] The token cache is being invalidate because project 97944dd7a73549cbb901d3c6cdf44e0f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:39.409923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.410683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.415567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1277/2573] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:39 2022] DELETE /identity/v3/projects/97944dd7a73549cbb901d3c6cdf44e0f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:39.417123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:39.430307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3397e7f7-fca0-47dd-a763-9ab9f4ffca1e service swift] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:39.493965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:39.494598 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:39.494879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:39.495574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] PATH_INFO: `/v3/users/da190bbba11f4284a97677db2d7d7938` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:39.497002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da190bbba11f4284a97677db2d7d7938)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:39.498911 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:39.547746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da190bbba11f4284a97677db2d7d7938'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.548425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da190bbba11f4284a97677db2d7d7938'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.556416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da190bbba11f4284a97677db2d7d7938'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.565467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da190bbba11f4284a97677db2d7d7938'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.580867 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-9309d028-1f56-4c45-9c91-7b3bf58f1598 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da190bbba11f4284a97677db2d7d7938'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:39.587549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1297/2574] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:39 2022] DELETE /identity/v3/users/da190bbba11f4284a97677db2d7d7938 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:39.885338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:39.886873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:39.899879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a588fd-01d6-48ba-9ae7-e661ddcda435 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:39.958407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:39.959065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:39.959366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:39.959636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] PATH_INFO: `/v3/projects/b0340266835a4c2f8a0fa4e9c71d82d0` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:39.960767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0340266835a4c2f8a0fa4e9c71d82d0)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:39.962645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.007704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:40.011919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0340266835a4c2f8a0fa4e9c71d82d0', 'request_id': 'req-7813a699-5df7-4d5b-93db-408f16a4028c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:40.018511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0340266835a4c2f8a0fa4e9c71d82d0', 'request_id': 'req-7813a699-5df7-4d5b-93db-408f16a4028c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:40.024686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0340266835a4c2f8a0fa4e9c71d82d0', 'request_id': 'req-7813a699-5df7-4d5b-93db-408f16a4028c'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:40.036727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] The token cache is being invalidate because project b0340266835a4c2f8a0fa4e9c71d82d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:40.037016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:40.037628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7813a699-5df7-4d5b-93db-408f16a4028c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:40.039235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1278/2575] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:39 2022] DELETE /identity/v3/projects/b0340266835a4c2f8a0fa4e9c71d82d0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:40.043941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.044437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.044535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.064850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:40.066052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:40.123329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1298/2576] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:40.131894 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.132212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.132489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.151457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:40.152681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:40.161050 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1279/2577] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:40.165198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.175720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a315a4-0085-45ee-ba71-4126a35cac74 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.180727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.181324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.181600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.181868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.182549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:40.182844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.184467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.193484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:40.197128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1299/2578] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:06:40.202099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.212082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4502cb31-e571-405b-a5dc-0c2f0122710e None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.216846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.217449 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.217734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.218005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.219428 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.221366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.254999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1280/2579] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:40.255468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.266203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d93f1d5-a37f-435a-9e19-ca4de96c9f62 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.324661 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.325303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.325585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.325865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.326506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.329296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.350968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1300/2580] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/users => generated 294 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:40.355152 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.365704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452bf869-d7bd-4b71-bc28-d6c96759c5e8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.370286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.371164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.371439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.371710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.372397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.374128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.390044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1281/2581] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:40.392292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.402585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dddcd922-a0f3-42a0-8503-cf9048a5e459 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.408291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3aac9c-8219-4e24-9d82-443be5290782 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.408894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aac9c-8219-4e24-9d82-443be5290782 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.409187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aac9c-8219-4e24-9d82-443be5290782 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.409461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3aac9c-8219-4e24-9d82-443be5290782 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.410161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aac9c-8219-4e24-9d82-443be5290782 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.411743 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3aac9c-8219-4e24-9d82-443be5290782 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.426197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1301/2582] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:40.427659 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.438490 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd9ab49-5e71-4744-a766-c16710704eeb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.443100 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.443824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.444021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.444323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] PATH_INFO: `/v3/projects/f0f1eb7eeb5a4c09b36fcfe13b1b164f/users/dc3009bec25a47819c55f5b4b31513b3/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.460827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f0f1eb7eeb5a4c09b36fcfe13b1b164f, user_id=dc3009bec25a47819c55f5b4b31513b3, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.463476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.476771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1282/2583] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:40 2022] PUT /identity/v3/projects/f0f1eb7eeb5a4c09b36fcfe13b1b164f/users/dc3009bec25a47819c55f5b4b31513b3/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:40.487266 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2260a-776e-48ef-9239-21484748305a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.487532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2260a-776e-48ef-9239-21484748305a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.487799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e2260a-776e-48ef-9239-21484748305a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.517094 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-14e2260a-776e-48ef-9239-21484748305a None None] MFA Rules not processed for user `dc3009bec25a47819c55f5b4b31513b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:40.518297 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-14e2260a-776e-48ef-9239-21484748305a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:40.582657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1302/2584] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:40.587399 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.650983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bec04b4-cff9-416d-8926-eb26764ba5a1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.657456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.658538 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.658841 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.659104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.659735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.661742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.690903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1283/2585] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/projects => generated 389 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:40.695030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2260a-776e-48ef-9239-21484748305a None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.706494 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e2260a-776e-48ef-9239-21484748305a None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.770808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.771429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.771761 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.772118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.772745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.775313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.793386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:40.804254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.815160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1303/2586] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:40 2022] POST /identity/v3/users => generated 301 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:40.818062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a3c4e-364a-44d8-8b56-f544faedbafb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.822764 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.823373 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.823652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.823922 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.824591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.826168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.841146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1284/2587] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:40.842624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.853989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a3923-91b7-43e5-ab48-d17d4fc0a2fc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.858734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.860217 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.860558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.861290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] PATH_INFO: `/v3/projects/e023b8042cd646568bb37a150c5bb319/users/d63c57cfb968477bb5357a058633c4a6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.878499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e023b8042cd646568bb37a150c5bb319, user_id=d63c57cfb968477bb5357a058633c4a6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.881355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:40.896916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1304/2588] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:40 2022] PUT /identity/v3/projects/e023b8042cd646568bb37a150c5bb319/users/d63c57cfb968477bb5357a058633c4a6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:40.901084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:40.922370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e46d43e-d618-416a-97e5-e1acf34a689d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:40.969261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:40.986998 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe7581d-17cf-44fc-9004-15e0a0cbd86f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:40.987596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7581d-17cf-44fc-9004-15e0a0cbd86f admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:40.987874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7581d-17cf-44fc-9004-15e0a0cbd86f admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:40.988182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe7581d-17cf-44fc-9004-15e0a0cbd86f admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:40.988820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7581d-17cf-44fc-9004-15e0a0cbd86f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:40.990391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe7581d-17cf-44fc-9004-15e0a0cbd86f admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:41.000150 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1285/2589] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:40 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:41.004303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:41.014669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa693e17-cffe-408e-a0ab-c1fbc870e820 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:41.019390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:41.020036 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:41.020346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:41.020614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] PATH_INFO: `/v3/projects/e023b8042cd646568bb37a150c5bb319/users/d63c57cfb968477bb5357a058633c4a6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:41.022508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e023b8042cd646568bb37a150c5bb319, user_id=d63c57cfb968477bb5357a058633c4a6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:41.025143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:41.035669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1305/2590] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:41 2022] PUT /identity/v3/projects/e023b8042cd646568bb37a150c5bb319/users/d63c57cfb968477bb5357a058633c4a6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:41.047527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:41.047807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:41.048107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:41.074578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] MFA Rules not processed for user `d63c57cfb968477bb5357a058633c4a6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:41.075767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:41.141443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1286/2591] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:41 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:41.152109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:41.153904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:41.212964 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca9f95e-34c1-4819-b567-e8a3cc07acf3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:41.216650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87dd774-a89d-4091-863d-0fecc1c12c8d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:41.217251 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd774-a89d-4091-863d-0fecc1c12c8d service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:41.217529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd774-a89d-4091-863d-0fecc1c12c8d service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:41.217803 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87dd774-a89d-4091-863d-0fecc1c12c8d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:41.227323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd774-a89d-4091-863d-0fecc1c12c8d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:41.228723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87dd774-a89d-4091-863d-0fecc1c12c8d service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:41.238630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1306/2592] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:41 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:41.375631 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:41.436265 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57179f7c-040e-4a61-9c3c-1bc1a5cf0592 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:41.441337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:41.441955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:41.442233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:41.442502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] PATH_INFO: `/v3/users/dc3009bec25a47819c55f5b4b31513b3` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:41.443601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] RBAC: Authorizing `identity:delete_user(user_id=dc3009bec25a47819c55f5b4b31513b3)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:41.445520 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:41.492325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'dc3009bec25a47819c55f5b4b31513b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:41.492917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'dc3009bec25a47819c55f5b4b31513b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:41.505621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'dc3009bec25a47819c55f5b4b31513b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:41.507278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:41.513792 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'dc3009bec25a47819c55f5b4b31513b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:41.521089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'dc3009bec25a47819c55f5b4b31513b3'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:41.526804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1287/2593] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:41 2022] DELETE /identity/v3/users/dc3009bec25a47819c55f5b4b31513b3 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:41.531352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:41.531662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:41.531933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:41.551763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:41.552971 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:41.611535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1307/2594] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:41.621459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:41.623089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:41.682926 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd9814a-f0f3-4029-ab82-5487e7243bba admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:41.686543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:41.687803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:41.688206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:41.688524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:41.697268 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:41.698670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:41.708629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1288/2595] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:42.213444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:42.214848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:42.227170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b00a8a1-5b77-44c1-8648-3095f7744c54 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:42.231830 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:42.232563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.232907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.233243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] PATH_INFO: `/v3/projects/f0f1eb7eeb5a4c09b36fcfe13b1b164f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.234961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f0f1eb7eeb5a4c09b36fcfe13b1b164f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:42.236961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:42.283270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f0f1eb7eeb5a4c09b36fcfe13b1b164f', 'request_id': 'req-e0c42aa9-b68e-4b37-b8a0-28105d745652'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.288857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f0f1eb7eeb5a4c09b36fcfe13b1b164f', 'request_id': 'req-e0c42aa9-b68e-4b37-b8a0-28105d745652'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.290499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:42.297555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f0f1eb7eeb5a4c09b36fcfe13b1b164f', 'request_id': 'req-e0c42aa9-b68e-4b37-b8a0-28105d745652'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.309530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] The token cache is being invalidate because project f0f1eb7eeb5a4c09b36fcfe13b1b164f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:42.309816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.310445 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.311980 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1308/2596] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:42 2022] DELETE /identity/v3/projects/f0f1eb7eeb5a4c09b36fcfe13b1b164f => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:42.316779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:42.326201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e987b514-6318-4255-abc4-61747cddd588 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:42.381783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:42.382397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.382672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.382943 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] PATH_INFO: `/v3/users/d63c57cfb968477bb5357a058633c4a6` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.384063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63c57cfb968477bb5357a058633c4a6)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:42.386028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:42.431051 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63c57cfb968477bb5357a058633c4a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.431703 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63c57cfb968477bb5357a058633c4a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.443290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63c57cfb968477bb5357a058633c4a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.450686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63c57cfb968477bb5357a058633c4a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.457887 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-354d79d3-ab81-4cf9-a8dc-a0a0bab65199 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63c57cfb968477bb5357a058633c4a6'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.463801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1289/2597] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:42 2022] DELETE /identity/v3/users/d63c57cfb968477bb5357a058633c4a6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:42.729933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:42.731415 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:42.745163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c42aa9-b68e-4b37-b8a0-28105d745652 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:42.803627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:42.804376 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.804643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.804912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] PATH_INFO: `/v3/projects/e023b8042cd646568bb37a150c5bb319` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.806007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e023b8042cd646568bb37a150c5bb319)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:42.807890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:42.853327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e023b8042cd646568bb37a150c5bb319', 'request_id': 'req-faf9b13e-fe7f-4785-80fe-9ecb112193c0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.859328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e023b8042cd646568bb37a150c5bb319', 'request_id': 'req-faf9b13e-fe7f-4785-80fe-9ecb112193c0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.866808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e023b8042cd646568bb37a150c5bb319', 'request_id': 'req-faf9b13e-fe7f-4785-80fe-9ecb112193c0'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.878542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] The token cache is being invalidate because project e023b8042cd646568bb37a150c5bb319 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:42.878831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.879474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-faf9b13e-fe7f-4785-80fe-9ecb112193c0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:42.881201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1309/2598] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:42 2022] DELETE /identity/v3/projects/e023b8042cd646568bb37a150c5bb319 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:42.886006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.886329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.886605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.895660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:42.907790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:42.909015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:42.968241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1290/2599] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:42.976504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:42.976786 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:42.977059 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:42.996738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:42.997939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:43.005890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1310/2600] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:43.010112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.020426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f8f0c2-0f4c-4d4a-ba5c-6df5c6c732ce None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.024925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.025513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.025787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.026054 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.026689 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:43.026988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.028590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.040606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1291/2601] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:06:43.044855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.054088 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c3c29de-de82-460a-9ab3-19132ea531ce None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.058730 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.059318 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.059594 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.059866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.060532 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.062534 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.090020 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1311/2602] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:43 2022] POST /identity/v3/projects => generated 407 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:43.094245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.104700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3f249d-e3ef-4076-8911-ac59783d0191 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.160914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.161433 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.161712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.161983 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.162590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.164544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.185015 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1292/2603] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:43 2022] POST /identity/v3/users => generated 304 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:43.189740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.199913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee81f022-43bd-4fd6-a04e-4fcbaa20bcc9 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.205714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.206300 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.206578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.206874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.207513 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.209162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.219520 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1312/2604] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:43.223458 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.233388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db8fbfd-1d20-406f-9916-571a60f88748 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.238006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4774181-f605-4af4-ae19-f143a72edbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.238598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4774181-f605-4af4-ae19-f143a72edbf0 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.238879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4774181-f605-4af4-ae19-f143a72edbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.239164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4774181-f605-4af4-ae19-f143a72edbf0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.239791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4774181-f605-4af4-ae19-f143a72edbf0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.241412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4774181-f605-4af4-ae19-f143a72edbf0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.253213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1293/2605] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:43.257204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.267753 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9baca4-f0c9-42db-bd18-41f12af842ba admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.272385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.273023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.273304 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.273580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] PATH_INFO: `/v3/projects/4b1c184cf839405d882d49971673f231/users/e0a6f0689876460db0d03ba0b6f2e028/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.287990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b1c184cf839405d882d49971673f231, user_id=e0a6f0689876460db0d03ba0b6f2e028, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.290632 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.303893 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1313/2606] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:43 2022] PUT /identity/v3/projects/4b1c184cf839405d882d49971673f231/users/e0a6f0689876460db0d03ba0b6f2e028/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:43.315586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.315868 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.316179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.343354 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] MFA Rules not processed for user `e0a6f0689876460db0d03ba0b6f2e028`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:43.344666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:43.404333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:43.408627 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1294/2607] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:43 2022] POST /identity/v3/auth/tokens => generated 3284 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:43.413110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.426498 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:INSERT=4,keystone:DELETE=8,keystone:SELECT=88 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:43.478333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d9fea2-c9a2-4bce-b0b2-3daa5aedb8b0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.482872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.483470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.483754 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.484027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.484697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.486579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.512458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1314/2608] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:43 2022] POST /identity/v3/projects => generated 401 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:43.517170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.527688 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1ce5db-b8bc-448d-a31f-1fd494b31a66 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.583111 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.583708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.583987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.584292 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.584910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.586828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.608581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1295/2609] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:43 2022] POST /identity/v3/users => generated 307 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:43.613286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.623687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb30cd32-ad1c-482f-9c14-898b3148bbdf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.629018 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.629610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.629896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.630170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.630807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.632481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.643206 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1315/2610] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:43.647226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.657107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef271e68-037f-4f36-a270-8bb63c12d951 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.661700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.662337 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.662616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.662886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] PATH_INFO: `/v3/projects/2c6b8172fc1a43198d6de7d5a4ea8e7c/users/40dbcf20d69c4808bb9ad6a99075feea/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.678722 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6b8172fc1a43198d6de7d5a4ea8e7c, user_id=40dbcf20d69c4808bb9ad6a99075feea, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.681360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.694566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1296/2611] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:43 2022] PUT /identity/v3/projects/2c6b8172fc1a43198d6de7d5a4ea8e7c/users/40dbcf20d69c4808bb9ad6a99075feea/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:43.698583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.708997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00884494-a4c7-40d1-b5f3-d97a08de9ffb admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.765162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc02ba6-422d-4802-a21b-f81710cacd6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.766278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02ba6-422d-4802-a21b-f81710cacd6e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.766552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02ba6-422d-4802-a21b-f81710cacd6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.766822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc02ba6-422d-4802-a21b-f81710cacd6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.767456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc02ba6-422d-4802-a21b-f81710cacd6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.769058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc02ba6-422d-4802-a21b-f81710cacd6e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.778560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1316/2612] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:43 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:43.783439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.793658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c99ee4-4de8-4ee1-ba82-571f366c12c4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.798426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.799071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.799353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.799628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] PATH_INFO: `/v3/projects/2c6b8172fc1a43198d6de7d5a4ea8e7c/users/40dbcf20d69c4808bb9ad6a99075feea/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.801587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c6b8172fc1a43198d6de7d5a4ea8e7c, user_id=40dbcf20d69c4808bb9ad6a99075feea, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:43.804274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:43.814372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1297/2613] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:43 2022] PUT /identity/v3/projects/2c6b8172fc1a43198d6de7d5a4ea8e7c/users/40dbcf20d69c4808bb9ad6a99075feea/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:43.824587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.824872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.825145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:43.853138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] MFA Rules not processed for user `40dbcf20d69c4808bb9ad6a99075feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:43.854325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:43.921717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1317/2614] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:43 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:43.932527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:43.934194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:43.994532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af48576-bd65-47d8-b1ca-0f7b9f72c9b4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:43.998419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:43.999016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:43.999295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:43.999566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:44.009119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:44.010560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:44.020845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1298/2615] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:43 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:44.168151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:44.178172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be481a6-1ba8-44f5-8a0e-3d54e6ffb9e5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:44.181660 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2cd8fb-28fe-4af7-a722-7ff0bee4e315 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:44.182247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd8fb-28fe-4af7-a722-7ff0bee4e315 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:44.182580 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd8fb-28fe-4af7-a722-7ff0bee4e315 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:44.182796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2cd8fb-28fe-4af7-a722-7ff0bee4e315 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:44.188650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:44.241099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cd8fb-28fe-4af7-a722-7ff0bee4e315 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:44.242542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2cd8fb-28fe-4af7-a722-7ff0bee4e315 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:44.252069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1318/2616] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:44 2022] GET /identity/v3/auth/tokens => generated 3284 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:49.611494 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:49.673094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:49.680797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447a8201-d3b2-405e-a44b-8c4a10a990f3 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:49.685747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:49.686363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:49.686637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:49.686909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] PATH_INFO: `/v3/users/e0a6f0689876460db0d03ba0b6f2e028` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:49.688203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0a6f0689876460db0d03ba0b6f2e028)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:49.690187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:49.736467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0a6f0689876460db0d03ba0b6f2e028'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:49.737120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0a6f0689876460db0d03ba0b6f2e028'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:49.749277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0a6f0689876460db0d03ba0b6f2e028'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:49.756350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0a6f0689876460db0d03ba0b6f2e028'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:49.763360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0a6f0689876460db0d03ba0b6f2e028'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:49.769692 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1299/2617] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:49 2022] DELETE /identity/v3/users/e0a6f0689876460db0d03ba0b6f2e028 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:49.774214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:49.774703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:49.774800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:49.794157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:49.795366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:49.857214 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1319/2618] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:49.866982 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:49.868390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:49.925308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79385154-4d44-49be-b5b3-e62979d5358d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:49.928927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:49.929527 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:49.929805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:49.930075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:49.939790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:49.941204 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:49.951178 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1300/2619] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:50.214349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:50.215822 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:50.229039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b6b718-ef4b-412a-bf17-88bc94f1648e None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:50.233650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:50.234849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.235137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.235478 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] PATH_INFO: `/v3/projects/4b1c184cf839405d882d49971673f231` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.236646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b1c184cf839405d882d49971673f231)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:50.238542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:50.286474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b1c184cf839405d882d49971673f231', 'request_id': 'req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.291843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b1c184cf839405d882d49971673f231', 'request_id': 'req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.299900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b1c184cf839405d882d49971673f231', 'request_id': 'req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.310842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] The token cache is being invalidate because project 4b1c184cf839405d882d49971673f231 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:50.311128 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.311758 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.314035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1320/2620] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:50 2022] DELETE /identity/v3/projects/4b1c184cf839405d882d49971673f231 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:50.318175 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:50.328061 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0036ec0-0fbe-4b72-821c-59aa89981170 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:50.384099 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:50.384727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.385008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.385282 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] PATH_INFO: `/v3/users/40dbcf20d69c4808bb9ad6a99075feea` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.386431 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40dbcf20d69c4808bb9ad6a99075feea)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:50.388370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:50.408812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:50.436457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40dbcf20d69c4808bb9ad6a99075feea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.437901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40dbcf20d69c4808bb9ad6a99075feea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.451486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40dbcf20d69c4808bb9ad6a99075feea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.460359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40dbcf20d69c4808bb9ad6a99075feea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.467041 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40dbcf20d69c4808bb9ad6a99075feea'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.472815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1301/2621] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:50 2022] DELETE /identity/v3/users/40dbcf20d69c4808bb9ad6a99075feea => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:50.548400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:50.550160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:50.587773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:50.618875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7bcb0d-a95c-4a2d-a0a0-c650970d7d3a admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:50.673331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:50.673949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.674230 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.674504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.676285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:50.736924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:50.738491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e55126b-9253-4ce6-9360-10f0e158bb8f service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:50.744211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:50.746048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:50.750697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1321/2622] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:50 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:50.824323 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ab85f4-319a-4de8-8c18-b25bec800459 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:50.829025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:50.829718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.829957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.830294 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] PATH_INFO: `/v3/projects/2c6b8172fc1a43198d6de7d5a4ea8e7c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.831509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c6b8172fc1a43198d6de7d5a4ea8e7c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:50.833646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:50.886165 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c6b8172fc1a43198d6de7d5a4ea8e7c', 'request_id': 'req-6aa42006-7f1d-4553-bc00-0ca90ef85202'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.893295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c6b8172fc1a43198d6de7d5a4ea8e7c', 'request_id': 'req-6aa42006-7f1d-4553-bc00-0ca90ef85202'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.899208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c6b8172fc1a43198d6de7d5a4ea8e7c', 'request_id': 'req-6aa42006-7f1d-4553-bc00-0ca90ef85202'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.912735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] The token cache is being invalidate because project 2c6b8172fc1a43198d6de7d5a4ea8e7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:50.913023 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.913675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6aa42006-7f1d-4553-bc00-0ca90ef85202 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:50.915342 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1302/2623] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:50 2022] DELETE /identity/v3/projects/2c6b8172fc1a43198d6de7d5a4ea8e7c => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:50.920030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:50.920550 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:50.920666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:50.944353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:50.945574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:51.006226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1322/2624] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:51.014065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.014383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.014681 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.036639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:51.037850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:51.045866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1303/2625] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:51.050533 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.060433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eefbd4ad-88af-4a6e-bc92-02c4d3050068 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.065456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.066177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.066462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.066738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.067395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:51.067729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.069373 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.086701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1323/2626] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:06:51.087875 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.098096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45889076-1d32-4ed3-9ed5-f6c0ebce999d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.103602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.104245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.104524 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.104828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.105422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.107360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.128365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:DELETE=15,keystone:SELECT=82,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:51.137255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1304/2627] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:51 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:51.141885 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.151851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8aaf76-0b59-4f10-a2b6-605c77f45ee8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.181923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:51.227434 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.228153 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.228648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.229090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.229727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.231717 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.259107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1324/2628] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:51 2022] POST /identity/v3/users => generated 286 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:51.264366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.275201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732e9065-71b1-4b64-a9aa-8154e125fadf admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.279867 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.280497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.280775 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.281566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.282838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.284465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.295136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1305/2629] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:51.300092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.310495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc309ee-91cf-45fb-a715-1049bc0a2c39 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.315874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f2bc417-e21d-4222-886a-ff2f56075df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.316548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bc417-e21d-4222-886a-ff2f56075df5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.316837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bc417-e21d-4222-886a-ff2f56075df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.317096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f2bc417-e21d-4222-886a-ff2f56075df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.317738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bc417-e21d-4222-886a-ff2f56075df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.319325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f2bc417-e21d-4222-886a-ff2f56075df5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.330280 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1325/2630] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:51.334495 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.344810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ad4dd34-50a0-4bab-af11-f96699251c86 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.349479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.350118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.350395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.350669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] PATH_INFO: `/v3/projects/631de4bd465444cd9133cba867ba7493/users/45d892dc3d194046b6c10cd8c75e9e6f/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.366055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=631de4bd465444cd9133cba867ba7493, user_id=45d892dc3d194046b6c10cd8c75e9e6f, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.368725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.382264 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1306/2631] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:51 2022] PUT /identity/v3/projects/631de4bd465444cd9133cba867ba7493/users/45d892dc3d194046b6c10cd8c75e9e6f/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:51.447779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.448089 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.448367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.478354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] MFA Rules not processed for user `45d892dc3d194046b6c10cd8c75e9e6f`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:51.479569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:51.542306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1326/2632] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:51.553976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.555763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:51.614311 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376ac898-15ef-4a97-99d6-b05b6a384f21 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.617951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa71b8-dc19-4211-af8e-4575d39567f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.618548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa71b8-dc19-4211-af8e-4575d39567f4 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.618821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa71b8-dc19-4211-af8e-4575d39567f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.619089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa71b8-dc19-4211-af8e-4575d39567f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.628565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa71b8-dc19-4211-af8e-4575d39567f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.630248 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa71b8-dc19-4211-af8e-4575d39567f4 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.639198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1307/2633] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:51.663924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.726510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aab6d80-c605-4a7f-a904-400cf7cb5d92 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.731342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.731967 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.732277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.732553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] PATH_INFO: `/v3/users/45d892dc3d194046b6c10cd8c75e9e6f` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.733685 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=45d892dc3d194046b6c10cd8c75e9e6f)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.735613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.776763 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:51.783811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '45d892dc3d194046b6c10cd8c75e9e6f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:51.784719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '45d892dc3d194046b6c10cd8c75e9e6f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:51.792082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '45d892dc3d194046b6c10cd8c75e9e6f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:51.799649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '45d892dc3d194046b6c10cd8c75e9e6f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:51.811284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '45d892dc3d194046b6c10cd8c75e9e6f'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:51.817792 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1327/2634] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:06:51 2022] DELETE /identity/v3/users/45d892dc3d194046b6c10cd8c75e9e6f => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:51.822346 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.822805 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.822901 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.842736 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:51.844030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:51.901818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1308/2635] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:51.912238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:51.913782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:51.971364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab549560-03cd-46e5-bf4e-b308f6821c03 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:51.975013 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da8e1c7-8174-4fbe-8153-d097dea895d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:51.975612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8e1c7-8174-4fbe-8153-d097dea895d3 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:51.975888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8e1c7-8174-4fbe-8153-d097dea895d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:51.976191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8e1c7-8174-4fbe-8153-d097dea895d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:51.985734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8e1c7-8174-4fbe-8153-d097dea895d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:51.987147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da8e1c7-8174-4fbe-8153-d097dea895d3 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:51.996756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1328/2636] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:52.257649 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.259778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:52.278181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfe1198-49e8-4977-a51c-411c80e24aec None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.283748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.284459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.284728 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.285027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] PATH_INFO: `/v3/projects/631de4bd465444cd9133cba867ba7493` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.286257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] RBAC: Authorizing `identity:delete_project(project_id=631de4bd465444cd9133cba867ba7493)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.288120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.339863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '631de4bd465444cd9133cba867ba7493', 'request_id': 'req-c839bd02-d4e1-42f7-aaf4-e813402072ff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:52.346007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '631de4bd465444cd9133cba867ba7493', 'request_id': 'req-c839bd02-d4e1-42f7-aaf4-e813402072ff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:52.347900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:52.353455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '631de4bd465444cd9133cba867ba7493', 'request_id': 'req-c839bd02-d4e1-42f7-aaf4-e813402072ff'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:52.368084 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] The token cache is being invalidate because project 631de4bd465444cd9133cba867ba7493 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:06:52.368513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:52.369266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c839bd02-d4e1-42f7-aaf4-e813402072ff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:06:52.371024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1309/2637] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:06:52 2022] DELETE /identity/v3/projects/631de4bd465444cd9133cba867ba7493 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:06:52.375846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.376163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.376440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.395657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:52.396875 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:52.457071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1329/2638] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:52.464927 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.465239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.465579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.487509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:52.488734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:52.497607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1310/2639] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:52.502606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.512870 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84728b5-6032-4d01-a5e6-070af9a6ef56 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.518295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.518906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.519223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.519530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.520227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:06:52.520555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.522203 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.538173 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1330/2640] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:06:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:06:52.539343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.549807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1740da33-21dc-46ac-962e-40ae657834ac None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.555133 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.555798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.556145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.556450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.557176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.559249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.592012 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1311/2641] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:52 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:52.593897 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.604151 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25e26b7-53a3-44a1-ad0e-1729b5801114 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.660455 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:52.676258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.676948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.677290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.677624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.678330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.680168 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.705231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1331/2642] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:52 2022] POST /identity/v3/users => generated 286 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:52.706261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.716859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f14214-b2be-4eb7-b73b-7de5d0d64ef5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.722201 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.722795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.723072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.723452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.724160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.725771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.736255 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1312/2643] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:52.740321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.750898 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55396316-e0b7-4ec0-8144-1ab6abbb4857 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.756181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dadec5-a3c0-4c98-9483-90626ffda626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.756777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dadec5-a3c0-4c98-9483-90626ffda626 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.757057 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dadec5-a3c0-4c98-9483-90626ffda626 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.757323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dadec5-a3c0-4c98-9483-90626ffda626 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.757963 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dadec5-a3c0-4c98-9483-90626ffda626 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.759541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dadec5-a3c0-4c98-9483-90626ffda626 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.772253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1332/2644] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:52 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:52.775823 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.794232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5d212c-886b-436f-a83a-40641053e59e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.801886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:52.802634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.802914 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.803184 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] PATH_INFO: `/v3/projects/784f7c8aff1045d89976fc42f1ef9593/users/3303c146b3c64b2ebace2f9dcfa4f445/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.818389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] RBAC: Authorizing `identity:create_grant(project_id=784f7c8aff1045d89976fc42f1ef9593, user_id=3303c146b3c64b2ebace2f9dcfa4f445, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:52.821173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:52.834452 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1313/2645] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:52 2022] PUT /identity/v3/projects/784f7c8aff1045d89976fc42f1ef9593/users/3303c146b3c64b2ebace2f9dcfa4f445/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:52.839495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fd2d8-3cc9-4d9a-9cca-b2743b4fd3f9 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:52.839778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fd2d8-3cc9-4d9a-9cca-b2743b4fd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:52.840069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3fd2d8-3cc9-4d9a-9cca-b2743b4fd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:52.859732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bc3fd2d8-3cc9-4d9a-9cca-b2743b4fd3f9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:52.860959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bc3fd2d8-3cc9-4d9a-9cca-b2743b4fd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:52.921232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1333/2646] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:06:52.931476 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:52.933289 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:52.995898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a674791e-8683-4138-a984-4749bafcaa73 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:52.999807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:53.000472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:53.000755 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:53.001033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:53.009951 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:53.011364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:53.020784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1314/2647] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:06:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:06:57.193983 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.194543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.194543 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.234487 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] MFA Rules not processed for user `3303c146b3c64b2ebace2f9dcfa4f445`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:06:57.235857 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:06:57.316091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1334/2648] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:06:57.320891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.331978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb354926-568c-42bb-bb2f-b063eea78dda service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.337260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.337876 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.338157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.338430 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.339302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.341845 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.376714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1315/2649] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/projects => generated 371 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:06:57.377810 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.388914 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c645884e-8619-483c-b7b0-bc61c8c5d771 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.454048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:57.464372 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.465656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.466385 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.467028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.467687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.470951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.502602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1335/2650] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:06:57 2022] POST /identity/v3/users => generated 292 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:06:57.506700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.518628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa0a0e-d364-4531-ae41-05119734646d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.523640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.524314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.524594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.524873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.525510 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.527136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.542639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1316/2651] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:57.548186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.558648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e07fb-a263-4a5f-8c61-4dab96f03eda admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.564325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.565001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.565285 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.565562 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] PATH_INFO: `/v3/projects/60288d533f894036a1f2615dcb2c6906/users/d956343810a948f0929546994038017f/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.582666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] RBAC: Authorizing `identity:create_grant(project_id=60288d533f894036a1f2615dcb2c6906, user_id=d956343810a948f0929546994038017f, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.585433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.603329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1336/2652] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:57 2022] PUT /identity/v3/projects/60288d533f894036a1f2615dcb2c6906/users/d956343810a948f0929546994038017f/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:06:57.608069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.618931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3541f5d-81db-4590-a360-0fc995289839 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.683584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:06:57.692355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709912a6-923e-4ca0-b0ab-f2be5b48d2a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.693103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709912a6-923e-4ca0-b0ab-f2be5b48d2a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.693493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709912a6-923e-4ca0-b0ab-f2be5b48d2a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.694145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709912a6-923e-4ca0-b0ab-f2be5b48d2a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.697340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709912a6-923e-4ca0-b0ab-f2be5b48d2a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.699212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709912a6-923e-4ca0-b0ab-f2be5b48d2a5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.713635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1317/2653] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:06:57 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:06:57.717821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:06:57.728901 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60bc482-60b5-42b3-a539-7e7774dc5eee admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:06:57.733760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:06:57.734452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:06:57.734731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:06:57.735024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] PATH_INFO: `/v3/projects/60288d533f894036a1f2615dcb2c6906/users/d956343810a948f0929546994038017f/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:06:57.737180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=60288d533f894036a1f2615dcb2c6906, user_id=d956343810a948f0929546994038017f, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:06:57.739813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:06:57.752599 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1337/2654] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:06:57 2022] PUT /identity/v3/projects/60288d533f894036a1f2615dcb2c6906/users/d956343810a948f0929546994038017f/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:02.810090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6578f08-b9b0-410c-9e29-66dafbcd6ddd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:02.810678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6578f08-b9b0-410c-9e29-66dafbcd6ddd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:02.810678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6578f08-b9b0-410c-9e29-66dafbcd6ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:02.849838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-b6578f08-b9b0-410c-9e29-66dafbcd6ddd None None] MFA Rules not processed for user `d956343810a948f0929546994038017f`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:02.851200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b6578f08-b9b0-410c-9e29-66dafbcd6ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:02.987088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1318/2655] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:02 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:02.994736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:03.001321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:03.092149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e66dba-7bca-4d0f-a9fd-7665607ada19 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:03.098948 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:03.099805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:03.099805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:03.100072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:03.181784 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:03.183538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:03.214180 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1338/2656] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:02 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:04.503384 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:04.503855 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:04.504700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:04.526142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] MFA Rules not processed for user `3303c146b3c64b2ebace2f9dcfa4f445`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:04.527438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:04.534730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1319/2657] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:04 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:08.207645 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:08.209137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:08.256568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:08.269159 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31118bfb-8fd6-413d-98c9-7a56840c2d15 service nova] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:08.272871 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:08.273480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:08.273764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:08.274037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:08.275819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:08.340227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:08.341666 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:08.351390 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1339/2658] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:11.704103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:11.706054 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:11.784349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:11.786327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:11.801900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67fc642a-c68c-46bd-bda2-ec1488f6e245 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:11.808495 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:11.809140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:11.809592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:11.809869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] PATH_INFO: `/v3/users/31607fccfbaf44c9b0ce1f663a83f8a1` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:11.811002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=31607fccfbaf44c9b0ce1f663a83f8a1)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:11.812260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c40984-83e9-4e82-8304-1e7ebcf88f0c None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:11.813880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:11.818497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:11.819457 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:11.819793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:11.820160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:11.822636 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:11.843981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:11.845858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:11.857818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1320/2659] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:11.878462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31607fccfbaf44c9b0ce1f663a83f8a1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:11.879229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31607fccfbaf44c9b0ce1f663a83f8a1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:11.887538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31607fccfbaf44c9b0ce1f663a83f8a1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:11.897851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31607fccfbaf44c9b0ce1f663a83f8a1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:11.910039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3a14fa4e-02e0-457c-b5ea-6b652222db3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31607fccfbaf44c9b0ce1f663a83f8a1'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:11.916060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1340/2660] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:11 2022] DELETE /identity/v3/users/31607fccfbaf44c9b0ce1f663a83f8a1 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:12.099874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.116774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cfa7e-ba5c-4569-9cea-60a92b07f32c service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.178362 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.178915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.179191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.179461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] PATH_INFO: `/v3/projects/4c3108f5ff924fb88002f19e00296d6a` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.180632 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3108f5ff924fb88002f19e00296d6a)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.182513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.184155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=100 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:12.229574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3108f5ff924fb88002f19e00296d6a', 'request_id': 'req-5477ed1b-e098-4808-89f3-16b61ff7d697'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:12.235847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3108f5ff924fb88002f19e00296d6a', 'request_id': 'req-5477ed1b-e098-4808-89f3-16b61ff7d697'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:12.242309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3108f5ff924fb88002f19e00296d6a', 'request_id': 'req-5477ed1b-e098-4808-89f3-16b61ff7d697'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:12.256115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] The token cache is being invalidate because project 4c3108f5ff924fb88002f19e00296d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:12.256410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:12.257063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-5477ed1b-e098-4808-89f3-16b61ff7d697 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:12.258557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1321/2661] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:12 2022] DELETE /identity/v3/projects/4c3108f5ff924fb88002f19e00296d6a => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:12.263566 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ee870-b533-475a-9fa2-253000f007cb None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.263853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ee870-b533-475a-9fa2-253000f007cb None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.264164 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ee870-b533-475a-9fa2-253000f007cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.284325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-717ee870-b533-475a-9fa2-253000f007cb None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:12.285508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-717ee870-b533-475a-9fa2-253000f007cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:12.345548 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1341/2662] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:12.353440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.353721 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.353996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.375492 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:12.376907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:12.385031 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1322/2663] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:12.389333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ee870-b533-475a-9fa2-253000f007cb None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.399604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ee870-b533-475a-9fa2-253000f007cb None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.406291 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.407124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.407501 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.407831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.408601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:12.409002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.411481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.413289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:12.428225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1342/2664] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:12.431056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.440525 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a9e5c5-bff8-44ca-911b-9fbbce5f329b None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.445277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.445864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.446142 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.446412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.447025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.449068 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.479592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1323/2665] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:12 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:12.484843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.494675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb3e652-3553-400d-80f6-95b8df4274f7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.551324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.551935 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.552243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.552517 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.553171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.555084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.577186 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1343/2666] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:12 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:12.581412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.591866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdfa561-41a5-4be3-89d3-3018a59c31e0 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.597881 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.598479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.598759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.599028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.599663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.601322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.611962 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1324/2667] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:12.616127 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.627263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5be98d5-fb8c-4003-818f-32a14b35e59b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.632105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b642284d-ea58-496e-890a-3f82932aa01c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.632723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642284d-ea58-496e-890a-3f82932aa01c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.633007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642284d-ea58-496e-890a-3f82932aa01c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.633276 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b642284d-ea58-496e-890a-3f82932aa01c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.633917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642284d-ea58-496e-890a-3f82932aa01c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.635507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b642284d-ea58-496e-890a-3f82932aa01c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.648352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1344/2668] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:12.652798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.662803 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8272bba-0261-4821-b380-47878df54459 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.667404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.668033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.668338 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.668608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] PATH_INFO: `/v3/projects/7442432ddec74c198af8e11647393730/users/7e1f6c32f8ce4b579dbbb1ab2a138745/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.683361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7442432ddec74c198af8e11647393730, user_id=7e1f6c32f8ce4b579dbbb1ab2a138745, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.686153 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.703228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1325/2669] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:12 2022] PUT /identity/v3/projects/7442432ddec74c198af8e11647393730/users/7e1f6c32f8ce4b579dbbb1ab2a138745/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:12.708816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531178-78b6-4941-87b8-68bd08a14309 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.709245 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531178-78b6-4941-87b8-68bd08a14309 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.709578 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de531178-78b6-4941-87b8-68bd08a14309 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.728793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-de531178-78b6-4941-87b8-68bd08a14309 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:12.730011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-de531178-78b6-4941-87b8-68bd08a14309 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:12.790574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1345/2670] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:12.801608 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:12.803305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:12.863640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5acef7-ff48-40f1-b386-e759e05e28c1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:12.867891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:12.868020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:12.868353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:12.868604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:12.879296 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:12.880795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:12.892304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1326/2671] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:17.250453 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc59f9-4721-4567-881e-597615360904 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.252102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc59f9-4721-4567-881e-597615360904 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.252546 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bc59f9-4721-4567-881e-597615360904 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.292926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-20bc59f9-4721-4567-881e-597615360904 None None] MFA Rules not processed for user `7e1f6c32f8ce4b579dbbb1ab2a138745`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:17.294332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-20bc59f9-4721-4567-881e-597615360904 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:17.406570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1346/2672] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:17.417940 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:17.419505 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:17.482262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:17.539377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e198de50-e375-43a1-a33a-f0f2c7c483b9 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:17.547180 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f92cefe-22e7-4b08-b818-d25cea16457c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:17.547866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92cefe-22e7-4b08-b818-d25cea16457c service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:17.548286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92cefe-22e7-4b08-b818-d25cea16457c service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:17.548500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f92cefe-22e7-4b08-b818-d25cea16457c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:17.559776 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92cefe-22e7-4b08-b818-d25cea16457c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:17.563921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f92cefe-22e7-4b08-b818-d25cea16457c service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:17.575863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1327/2673] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:18.299807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc59f9-4721-4567-881e-597615360904 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:18.304490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:18.310945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bc59f9-4721-4567-881e-597615360904 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:18.316451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:18.318195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:18.318683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:18.319102 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:18.321568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:18.332817 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:18.335145 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:18.346184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1347/2674] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:19.661765 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:19.662329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:19.662329 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:19.701426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] MFA Rules not processed for user `7e1f6c32f8ce4b579dbbb1ab2a138745`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:19.703470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:19.717724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1328/2675] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:19 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:22.417945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:22.421355 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:22.432656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1687b4-84c1-4f36-abf3-4aa5d46428ba service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:22.437108 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:22.437808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:22.438092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:22.438394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:22.440337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:22.462005 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:22.463742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:22.477701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1348/2676] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:26.292536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:26.294385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:26.353325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:26.354769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:26.370329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e3beae1-a648-4dc8-9026-0f57311681ec service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:26.376242 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:26.376906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.377188 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.377463 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] PATH_INFO: `/v3/users/ce7b1f7925614a2b9cf9d2c7eaf2b7f7` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.378624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce7b1f7925614a2b9cf9d2c7eaf2b7f7)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:26.380646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:26.381852 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2843fd1a-e619-473a-8977-4a5ecbc0b13f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:26.387782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:26.388545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.389336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.389622 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.391607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:26.403667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:26.406029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:26.422724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1329/2677] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:26.431652 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce7b1f7925614a2b9cf9d2c7eaf2b7f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.432416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce7b1f7925614a2b9cf9d2c7eaf2b7f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.441713 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce7b1f7925614a2b9cf9d2c7eaf2b7f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.448912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce7b1f7925614a2b9cf9d2c7eaf2b7f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.464090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-1902beb8-7615-4e16-8cf8-e847b76eb141 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce7b1f7925614a2b9cf9d2c7eaf2b7f7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.470664 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1349/2678] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:26 2022] DELETE /identity/v3/users/ce7b1f7925614a2b9cf9d2c7eaf2b7f7 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:26.734134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:26.745768 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bec6ef-646f-4114-9876-f611db1f81ab service placement] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:26.816787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:26.817416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.817695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.817968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] PATH_INFO: `/v3/projects/3f0976be663b4253bd8a392d40236df2` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.819071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f0976be663b4253bd8a392d40236df2)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:26.821027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:26.860395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:26.868064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f0976be663b4253bd8a392d40236df2', 'request_id': 'req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.875383 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f0976be663b4253bd8a392d40236df2', 'request_id': 'req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.882454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f0976be663b4253bd8a392d40236df2', 'request_id': 'req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.898439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] The token cache is being invalidate because project 3f0976be663b4253bd8a392d40236df2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:26.898730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.899359 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-80a9f4ac-ab15-4ffd-aacc-38136ec1462e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:26.901029 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1330/2679] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:26 2022] DELETE /identity/v3/projects/3f0976be663b4253bd8a392d40236df2 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:26.906132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:26.906439 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:26.906712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:26.929085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:26.930289 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:27.006442 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1350/2680] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:27.015411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.015700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.016385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.041469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:27.042678 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:27.051385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1331/2681] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:27.055760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.066681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1a4bde-6b11-47ec-994f-812cb4508094 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.071421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.072133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.072416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.072690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.073343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:27.073646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.075243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.087160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1351/2682] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:27.091670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.100913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b81dbb-a129-47f4-804a-1fd9edcea6e8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.105568 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.106172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.106450 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.106724 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.107341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.109788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.138415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1332/2683] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:27 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:27.143075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.153531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28424a3-897b-44a5-916e-d53dc9154771 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.189544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:27.219432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.220058 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.220432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.220710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.221351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.223264 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.245993 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1352/2684] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:27 2022] POST /identity/v3/users => generated 283 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:27.250864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.261181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e49cc4-3102-4b21-b737-bed8902d9b26 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.265917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.266550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.266847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.267122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.267795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.269482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.283006 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1333/2685] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:27.284416 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.294639 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c2b7499-9acf-498c-ac3a-327c21e53d2c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.300650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b588193-af57-4cb7-b53d-72d3dc2863a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.301729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b588193-af57-4cb7-b53d-72d3dc2863a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.301729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b588193-af57-4cb7-b53d-72d3dc2863a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.301975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b588193-af57-4cb7-b53d-72d3dc2863a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.302710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b588193-af57-4cb7-b53d-72d3dc2863a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.304408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b588193-af57-4cb7-b53d-72d3dc2863a7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.315404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1353/2686] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:27.319630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.330570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a037129-e299-400a-b967-3b41f9108f29 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.335395 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.336077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.336351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.336628 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] PATH_INFO: `/v3/projects/5152cd5c42f641f6844a12b5aa01334c/users/7e651ba2924c4b60962fb626d698f455/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.361417 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5152cd5c42f641f6844a12b5aa01334c, user_id=7e651ba2924c4b60962fb626d698f455, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.364206 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.379303 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1334/2687] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:27 2022] PUT /identity/v3/projects/5152cd5c42f641f6844a12b5aa01334c/users/7e651ba2924c4b60962fb626d698f455/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:27.389606 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.390109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.390219 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.417582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] MFA Rules not processed for user `7e651ba2924c4b60962fb626d698f455`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:27.418779 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:27.484461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1354/2688] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:27 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:27.495700 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:27.497437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:27.560634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec07970-9aa2-495b-83fb-18d036c4ac94 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:27.564871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:27.565478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:27.565758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:27.566030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:27.574921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:27.576526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:27.586191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1335/2689] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:27 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:30.569708 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:30.571202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:30.634400 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9faf2775-83bf-4ab9-8882-cb1d2c3269b2 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:30.638163 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:30.638793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:30.639070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:30.639370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:30.641698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:30.719162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:30.723337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:30.725351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:30.739027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1355/2690] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:32.734130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:32.736286 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:32.827071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:32.836461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1032e66-8c35-4d6d-ac95-553b708dfb26 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:32.842170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a4e5a17f91134c59bec66f04a175ef05', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'ResellerAdmin', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:32.843427 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:32.843766 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:32.844207 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:32.846448 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:32.861616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:32.863925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d119de-4aae-4e0c-83b5-fd24d77a3a3b service nova] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:32.882262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1336/2691] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:36.224613 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.294320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cadec8-8804-4ce0-91eb-5c50668fcf5d service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.299563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.300248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.300530 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.300804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] PATH_INFO: `/v3/users/7e651ba2924c4b60962fb626d698f455` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.301938 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e651ba2924c4b60962fb626d698f455)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.303923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.354778 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e651ba2924c4b60962fb626d698f455'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.355441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e651ba2924c4b60962fb626d698f455'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.363601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e651ba2924c4b60962fb626d698f455'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.371071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e651ba2924c4b60962fb626d698f455'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.384003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e651ba2924c4b60962fb626d698f455'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.390802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1356/2692] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:36 2022] DELETE /identity/v3/users/7e651ba2924c4b60962fb626d698f455 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:36.395374 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.396154 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.396477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.415880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:36.417113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.478530 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1337/2693] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:36.489104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.490497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.548133 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8710c8-db15-4b23-81a8-8648a2179448 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.551777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d187ee6-3a1b-42ae-b9ab-68ff4e319150 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.552441 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d187ee6-3a1b-42ae-b9ab-68ff4e319150 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.552723 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d187ee6-3a1b-42ae-b9ab-68ff4e319150 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.552999 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d187ee6-3a1b-42ae-b9ab-68ff4e319150 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.563782 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d187ee6-3a1b-42ae-b9ab-68ff4e319150 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.565307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d187ee6-3a1b-42ae-b9ab-68ff4e319150 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.575116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1357/2694] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:36.851349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:36.852804 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.864993 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28eb3f-88dd-4cb3-9cd5-23c55c797e27 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:36.870027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:36.870691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.870973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.871305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] PATH_INFO: `/v3/projects/5152cd5c42f641f6844a12b5aa01334c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.872858 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5152cd5c42f641f6844a12b5aa01334c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:36.875412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:36.924335 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5152cd5c42f641f6844a12b5aa01334c', 'request_id': 'req-898b3da4-446c-4000-af52-c765cc3a68c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.929645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5152cd5c42f641f6844a12b5aa01334c', 'request_id': 'req-898b3da4-446c-4000-af52-c765cc3a68c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.938839 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5152cd5c42f641f6844a12b5aa01334c', 'request_id': 'req-898b3da4-446c-4000-af52-c765cc3a68c4'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.954089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] The token cache is being invalidate because project 5152cd5c42f641f6844a12b5aa01334c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:36.954379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.955019 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-898b3da4-446c-4000-af52-c765cc3a68c4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:36.956559 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1338/2695] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:36 2022] DELETE /identity/v3/projects/5152cd5c42f641f6844a12b5aa01334c => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:36.961565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:36.961789 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:36.962066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:36.982045 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:36.983690 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:36.993395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:37.045622 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1358/2696] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:07:37.053639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.054026 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.054331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.073711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.074912 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.083357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1339/2697] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:37.087581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.097869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5538cea6-e8c3-49f2-b465-bd9ee234c2d7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.102648 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.103243 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.103526 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.103800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.104587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:37.104892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.106483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.118132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1359/2698] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:37.122693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.132694 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b2d05-e8db-46d2-9174-6683037218c8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.137477 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.138066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.138378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.138651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.140028 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.142075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.168866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1340/2699] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/projects => generated 393 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:37.173421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.183468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ddbce-1d51-45ea-b62b-f8ec738c6d50 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.240270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.240873 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.241143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.241418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.242041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.243953 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.266076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1360/2700] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:07:37.271824 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.282222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3b0d7-1881-49c5-895f-9e38425fab39 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.286853 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.287447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.287730 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.288005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.288683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.290266 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.300795 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1341/2701] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:37.304807 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.315336 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e5af70-ca74-489a-b5ac-d4ce301f57f7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.319978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252557d6-a2f8-4ffd-850f-34e2c80e57b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.320604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252557d6-a2f8-4ffd-850f-34e2c80e57b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.320888 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252557d6-a2f8-4ffd-850f-34e2c80e57b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.321165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252557d6-a2f8-4ffd-850f-34e2c80e57b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.321811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252557d6-a2f8-4ffd-850f-34e2c80e57b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.323429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252557d6-a2f8-4ffd-850f-34e2c80e57b0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.334665 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1361/2702] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:37.338620 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.348646 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42955ac9-9ab7-4c20-be00-eab448a9a717 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.353241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.353871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.354151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.354426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] PATH_INFO: `/v3/projects/15546de9b38746e2b554b6eef3fefe55/users/f99d266fc2bd442b9c87c23d85d7521a/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.368999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=15546de9b38746e2b554b6eef3fefe55, user_id=f99d266fc2bd442b9c87c23d85d7521a, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.371873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.385567 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1342/2703] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:37 2022] PUT /identity/v3/projects/15546de9b38746e2b554b6eef3fefe55/users/f99d266fc2bd442b9c87c23d85d7521a/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:37.396331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.396616 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.396889 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.424096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] MFA Rules not processed for user `f99d266fc2bd442b9c87c23d85d7521a`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.425319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:37.490106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1362/2704] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:37.494849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.507810 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:37.560390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb42dcab-11d6-42be-8389-c4c78414ea00 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.566014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.566618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.566899 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.567174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.567811 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.569793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.595979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1343/2705] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/projects => generated 391 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:37.600366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.611663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619e2868-86ab-46c1-a23e-446210f5f165 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.619456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:37.669705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.670978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.671261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.671524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.672181 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.674073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.696119 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1363/2706] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/users => generated 302 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:37.699579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.709999 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9aa947-ed4c-42f3-8566-f1993d75a4d7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.714590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.715183 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.715467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.715741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.716421 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.718134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.729603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1344/2707] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:37.734480 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.744866 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac294f-0bfc-48a5-995c-1876107e8944 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.750579 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.751225 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.751508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.751787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] PATH_INFO: `/v3/projects/c4f656d5acaa4d2388f24b495ea07a91/users/f47f80f058284062b2ea51a6d019d70a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.767852 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f656d5acaa4d2388f24b495ea07a91, user_id=f47f80f058284062b2ea51a6d019d70a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.770505 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.783160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1364/2708] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:37 2022] PUT /identity/v3/projects/c4f656d5acaa4d2388f24b495ea07a91/users/f47f80f058284062b2ea51a6d019d70a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:37.787102 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.797543 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357be0f2-10a9-4140-be6d-42913bb0202a admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.854097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74b7f8d0-6bef-44c9-8747-5a549d9459df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.854734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7f8d0-6bef-44c9-8747-5a549d9459df admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.855024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7f8d0-6bef-44c9-8747-5a549d9459df admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.855336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74b7f8d0-6bef-44c9-8747-5a549d9459df admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.855973 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7f8d0-6bef-44c9-8747-5a549d9459df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.857695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74b7f8d0-6bef-44c9-8747-5a549d9459df admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.867957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1345/2709] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:37 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:37.872383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:37.882450 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb13f90-9a64-415e-a0c5-15b518695418 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:37.887047 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:37.887683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.887961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.888260 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] PATH_INFO: `/v3/projects/c4f656d5acaa4d2388f24b495ea07a91/users/f47f80f058284062b2ea51a6d019d70a/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.890183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f656d5acaa4d2388f24b495ea07a91, user_id=f47f80f058284062b2ea51a6d019d70a, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:37.892805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:37.904079 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1365/2710] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:37 2022] PUT /identity/v3/projects/c4f656d5acaa4d2388f24b495ea07a91/users/f47f80f058284062b2ea51a6d019d70a/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:37.915000 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:37.915284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:37.915562 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:37.945515 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] MFA Rules not processed for user `f47f80f058284062b2ea51a6d019d70a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:37.946751 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.014139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1346/2711] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:37 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:38.025001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.026693 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.089955 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2a36ec-843b-4828-9b66-05ca188c4857 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.094312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.094915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.095193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.095468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.104366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.105794 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.115701 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1366/2712] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:38.161297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:38.162677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:38.175548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446b3fe-78dd-463a-9c90-23e8555b04fd None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:38.179182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c91d0d-3703-4883-80a0-b731c0f09bd1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:38.179774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91d0d-3703-4883-80a0-b731c0f09bd1 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:38.180067 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91d0d-3703-4883-80a0-b731c0f09bd1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:38.180352 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c91d0d-3703-4883-80a0-b731c0f09bd1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:38.184438 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:38.241256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91d0d-3703-4883-80a0-b731c0f09bd1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:38.242723 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70c91d0d-3703-4883-80a0-b731c0f09bd1 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:38.252555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1347/2713] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:41.532122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:41.594156 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ef2d37-20ce-42fe-b7aa-4e080c3632c4 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:41.598654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:41.599330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:41.599607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:41.599880 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] PATH_INFO: `/v3/users/f99d266fc2bd442b9c87c23d85d7521a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:41.601026 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99d266fc2bd442b9c87c23d85d7521a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:41.602929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:41.608433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:41.651814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99d266fc2bd442b9c87c23d85d7521a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:41.652511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99d266fc2bd442b9c87c23d85d7521a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:41.659604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99d266fc2bd442b9c87c23d85d7521a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:41.666424 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99d266fc2bd442b9c87c23d85d7521a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:41.678284 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99d266fc2bd442b9c87c23d85d7521a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:41.684170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1367/2714] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:41 2022] DELETE /identity/v3/users/f99d266fc2bd442b9c87c23d85d7521a => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:41.689357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:41.689850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:41.689959 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:41.709992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:41.711254 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:41.771969 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1348/2715] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:41.781796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:41.783227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:41.840528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6dd551-a00b-4b42-b9c6-091e38e668a4 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:41.844309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:41.844831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:41.845110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:41.845379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:41.854446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:41.855859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:41.865461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1368/2716] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:42.143065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:42.144639 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:42.158130 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c133156b-04b9-45b1-82f5-e6f2e833d7a5 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:42.162846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:42.163481 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.163760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.164089 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] PATH_INFO: `/v3/projects/15546de9b38746e2b554b6eef3fefe55` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.165284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] RBAC: Authorizing `identity:delete_project(project_id=15546de9b38746e2b554b6eef3fefe55)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:42.167198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:42.214925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '15546de9b38746e2b554b6eef3fefe55', 'request_id': 'req-c6f7a9c2-9907-41f2-a744-fa3635b6221d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.220886 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '15546de9b38746e2b554b6eef3fefe55', 'request_id': 'req-c6f7a9c2-9907-41f2-a744-fa3635b6221d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.227579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '15546de9b38746e2b554b6eef3fefe55', 'request_id': 'req-c6f7a9c2-9907-41f2-a744-fa3635b6221d'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.240826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] The token cache is being invalidate because project 15546de9b38746e2b554b6eef3fefe55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:42.241145 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.241760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.243246 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1349/2717] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:42 2022] DELETE /identity/v3/projects/15546de9b38746e2b554b6eef3fefe55 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:42.247481 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:42.258277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518dd9c2-67d4-41af-a463-47f153a790fe service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:42.315628 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:42.316313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.316592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.316861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] PATH_INFO: `/v3/users/f47f80f058284062b2ea51a6d019d70a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.317994 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47f80f058284062b2ea51a6d019d70a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:42.319904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:42.352952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:42.368692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47f80f058284062b2ea51a6d019d70a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.369585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47f80f058284062b2ea51a6d019d70a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.376559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47f80f058284062b2ea51a6d019d70a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.383474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47f80f058284062b2ea51a6d019d70a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.395286 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-ce89a6ee-9b4f-4e5a-9671-153e91ad3d6d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47f80f058284062b2ea51a6d019d70a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.401239 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1369/2718] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:42 2022] DELETE /identity/v3/users/f47f80f058284062b2ea51a6d019d70a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:42.673290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:42.674826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:42.690048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f7a9c2-9907-41f2-a744-fa3635b6221d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:42.718355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:42.753116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:42.753749 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.754027 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.754302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] PATH_INFO: `/v3/projects/c4f656d5acaa4d2388f24b495ea07a91` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.755411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f656d5acaa4d2388f24b495ea07a91)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:42.757324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:42.803260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f656d5acaa4d2388f24b495ea07a91', 'request_id': 'req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.808640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f656d5acaa4d2388f24b495ea07a91', 'request_id': 'req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.815251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f656d5acaa4d2388f24b495ea07a91', 'request_id': 'req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.828682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] The token cache is being invalidate because project c4f656d5acaa4d2388f24b495ea07a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:42.828970 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.829587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b46a36a6-90ff-47a6-ac7b-2c4ff2e7f3b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:42.831117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1350/2719] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:42 2022] DELETE /identity/v3/projects/c4f656d5acaa4d2388f24b495ea07a91 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:42.836019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.836524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.836624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.856655 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:42.857869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:42.916998 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1370/2720] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:42.926200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.926489 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.926767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.946687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:42.947905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:42.956793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1351/2721] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:42.961090 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:42.971797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2632d541-43a6-40c7-bdf6-1582ef600563 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:42.976418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:42.977012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:42.977295 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:42.977570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:42.978220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:42.978524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:42.980149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:42.991576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1371/2722] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:42.996107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.006358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaa8e8-d873-4c4a-b493-c318db08e0d1 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.011191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.011782 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.012094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.012369 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.012992 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.014919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.042528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1352/2723] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:42 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:43.046747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.057322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cb018d-5185-4d9a-800d-26acb4db8caf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.113837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.114538 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.114806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.115076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.115692 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.117636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.138947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1372/2724] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:43 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:43.143635 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.153806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b542b2f-8a42-4738-a47c-5ba411c73911 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.158488 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.159086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.159366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.159641 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.160317 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.161895 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.171849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1353/2725] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:43.175451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.185574 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5637d8-8e1c-479b-9ae3-29729d2ec799 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.190905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a0567f-6204-4e12-824a-c6ebcf59178f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.191490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0567f-6204-4e12-824a-c6ebcf59178f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.191770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0567f-6204-4e12-824a-c6ebcf59178f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.192060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a0567f-6204-4e12-824a-c6ebcf59178f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.192706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0567f-6204-4e12-824a-c6ebcf59178f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.194371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a0567f-6204-4e12-824a-c6ebcf59178f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.205750 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1373/2726] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:43.210140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.221043 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25781eda-a655-4952-9d9d-46834d5b9c35 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.226422 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.227086 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.227368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.227640 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] PATH_INFO: `/v3/projects/0d5732f788e54c54b32afc4e003a73fa/users/7ef6678329e04630971ce329b579cfbf/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.243276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5732f788e54c54b32afc4e003a73fa, user_id=7ef6678329e04630971ce329b579cfbf, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.246195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.259529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1354/2727] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:43 2022] PUT /identity/v3/projects/0d5732f788e54c54b32afc4e003a73fa/users/7ef6678329e04630971ce329b579cfbf/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:43.270698 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.270989 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.271258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.297568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:43.300981 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] MFA Rules not processed for user `7ef6678329e04630971ce329b579cfbf`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:43.302776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:43.368122 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1374/2728] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:43.372818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.429613 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:43.434660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee54250-1d0d-48e2-806a-fc84ccfb29a9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.440931 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.441591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.442075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.442357 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.442997 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.444957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.473087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1355/2729] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:43 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:43.477107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.488342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaaee81-5a8c-4c25-9eed-2a729bdbaf62 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.542468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.543066 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.543342 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.543614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.544265 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.546197 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.570811 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1375/2730] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:43 2022] POST /identity/v3/users => generated 297 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:43.571975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.582925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17833ad-fcb4-49a2-9cf5-e20d2d4a71f8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.587693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.588345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.588726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.589024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.589669 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.591238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.602378 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1356/2731] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:07:43.606460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.616630 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988d6457-3df7-4750-9a3e-93b9d2110800 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.621549 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.622191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.622468 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.622740 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] PATH_INFO: `/v3/projects/6c2fab205a284e82be89af5d06fef4d1/users/38fcc51f39224e6595ca4155a0316af6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.637420 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fab205a284e82be89af5d06fef4d1, user_id=38fcc51f39224e6595ca4155a0316af6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.640028 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.652958 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1376/2732] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:43 2022] PUT /identity/v3/projects/6c2fab205a284e82be89af5d06fef4d1/users/38fcc51f39224e6595ca4155a0316af6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:43.657416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.667281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-004fa25c-3f7d-419b-94c3-b8e24b04cae5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.723155 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d80941-6b7f-45b1-ae35-2d4ab859bc55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.724128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d80941-6b7f-45b1-ae35-2d4ab859bc55 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.724128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d80941-6b7f-45b1-ae35-2d4ab859bc55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.724128 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d80941-6b7f-45b1-ae35-2d4ab859bc55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.724797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d80941-6b7f-45b1-ae35-2d4ab859bc55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.726368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d80941-6b7f-45b1-ae35-2d4ab859bc55 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.736592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1357/2733] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:43 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:43.740544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.751043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c1d6c1-9afc-4900-94d1-8eeae06c5e8d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.755912 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.756584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.756861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.757134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] PATH_INFO: `/v3/projects/6c2fab205a284e82be89af5d06fef4d1/users/38fcc51f39224e6595ca4155a0316af6/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.759068 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c2fab205a284e82be89af5d06fef4d1, user_id=38fcc51f39224e6595ca4155a0316af6, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.761791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.772720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1377/2734] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:43 2022] PUT /identity/v3/projects/6c2fab205a284e82be89af5d06fef4d1/users/38fcc51f39224e6595ca4155a0316af6/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:43.783321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.783602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.783871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.810485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] MFA Rules not processed for user `38fcc51f39224e6595ca4155a0316af6`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:43.811889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:43.880332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1358/2735] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:43 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:43.892350 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:43.894198 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:43.952729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1466dea-c8fc-402c-a3c1-3b145c661f76 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:43.956586 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:43.957444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:43.957859 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:43.958177 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:43.967952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:43.969939 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:43.974015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:43.981329 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1378/2736] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:43 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:44.054470 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:44.063955 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf929d1-1644-4c9e-ae37-0fcf93383b0a None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:44.067516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95abfde-29f6-4366-a658-164f68502c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:44.068158 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95abfde-29f6-4366-a658-164f68502c90 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:44.068437 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95abfde-29f6-4366-a658-164f68502c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:44.068704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95abfde-29f6-4366-a658-164f68502c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:44.115938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:44.127005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95abfde-29f6-4366-a658-164f68502c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:44.128468 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95abfde-29f6-4366-a658-164f68502c90 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:44.137519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1359/2737] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:44 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:44.402184 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:44.464561 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0678419a-4db5-4215-9f89-5b5bc9789090 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:44.469780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:44.470408 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:44.470711 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:44.470987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] PATH_INFO: `/v3/users/7ef6678329e04630971ce329b579cfbf` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:44.472134 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ef6678329e04630971ce329b579cfbf)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:44.474035 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:44.520844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ef6678329e04630971ce329b579cfbf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:44.521418 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ef6678329e04630971ce329b579cfbf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:44.528506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ef6678329e04630971ce329b579cfbf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:44.535374 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ef6678329e04630971ce329b579cfbf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:44.547292 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ef6678329e04630971ce329b579cfbf'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:44.553312 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1379/2738] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:44 2022] DELETE /identity/v3/users/7ef6678329e04630971ce329b579cfbf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:44.557925 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:44.558202 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:44.558471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:44.577780 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:44.579060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:44.636451 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1360/2739] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:44.646346 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:44.647735 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:44.704805 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779b8b-4458-4d9a-a981-4b8e93014a50 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:44.708387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:44.708978 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:44.709261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:44.709528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:44.718945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:44.720587 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:44.729841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1380/2740] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 25 03:07:45.001979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:45.003518 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:45.016203 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66275fab-ce98-4544-9aec-8674ae3fec68 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:45.021112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:45.021762 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.022053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.022305 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] PATH_INFO: `/v3/projects/0d5732f788e54c54b32afc4e003a73fa` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.023486 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5732f788e54c54b32afc4e003a73fa)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:45.025410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:45.072756 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5732f788e54c54b32afc4e003a73fa', 'request_id': 'req-cd949872-3d4f-4136-8bad-467a98a72c28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.079170 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5732f788e54c54b32afc4e003a73fa', 'request_id': 'req-cd949872-3d4f-4136-8bad-467a98a72c28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.085411 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5732f788e54c54b32afc4e003a73fa', 'request_id': 'req-cd949872-3d4f-4136-8bad-467a98a72c28'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.098126 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] The token cache is being invalidate because project 0d5732f788e54c54b32afc4e003a73fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:45.098440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.099052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.100563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1361/2741] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:45 2022] DELETE /identity/v3/projects/0d5732f788e54c54b32afc4e003a73fa => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:45.104627 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:45.114518 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f961e1d-df2c-476e-a0fb-290c5ae60a14 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:45.130653 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:45.171567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:45.172248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.172531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.172808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] PATH_INFO: `/v3/users/38fcc51f39224e6595ca4155a0316af6` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.173930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fcc51f39224e6595ca4155a0316af6)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:45.175843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:45.220365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fcc51f39224e6595ca4155a0316af6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.221011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fcc51f39224e6595ca4155a0316af6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.228237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fcc51f39224e6595ca4155a0316af6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.235540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fcc51f39224e6595ca4155a0316af6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.247524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-d73478cb-f05b-4400-ab81-62c1ec911a8f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fcc51f39224e6595ca4155a0316af6'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.253407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1381/2742] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:07:45 2022] DELETE /identity/v3/users/38fcc51f39224e6595ca4155a0316af6 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:07:45.522905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:45.524699 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:45.537653 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd949872-3d4f-4136-8bad-467a98a72c28 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:45.595081 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:45.595710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.595989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.596293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] PATH_INFO: `/v3/projects/6c2fab205a284e82be89af5d06fef4d1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.597454 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c2fab205a284e82be89af5d06fef4d1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:45.599277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:45.615132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:45.649624 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c2fab205a284e82be89af5d06fef4d1', 'request_id': 'req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.655135 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c2fab205a284e82be89af5d06fef4d1', 'request_id': 'req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.661262 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c2fab205a284e82be89af5d06fef4d1', 'request_id': 'req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.673837 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] The token cache is being invalidate because project 6c2fab205a284e82be89af5d06fef4d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:07:45.674132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.674763 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6e0d183d-c6ef-4ab7-89d3-4b2a66258b2b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:07:45.676461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1362/2743] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:07:45 2022] DELETE /identity/v3/projects/6c2fab205a284e82be89af5d06fef4d1 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:45.683283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.683601 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.683876 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.704421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:45.705624 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:45.766707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1382/2744] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:45.774579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.774913 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.775173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.795778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:45.797733 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:45.805642 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1363/2745] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:45.809851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:45.820470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103b8fcb-e82f-4137-a4cf-6dbc677d2e27 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:45.824984 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:45.825575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.825854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.826125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.826769 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:07:45.827073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:45.829353 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:45.840712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1383/2746] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:07:45.845469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:45.854602 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b12c1c-baba-4881-bad0-f2d5f2425a1f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:45.859360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:45.859958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.860270 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.860577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.861208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:45.863080 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:45.889301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1364/2747] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:07:45 2022] POST /identity/v3/projects => generated 369 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:45.894137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:45.904364 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a598c4cd-fa0a-4714-87bd-cfcc500570fe admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:45.928760 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:45.962861 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:45.963462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:45.963739 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:45.964007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:45.964668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:45.966559 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:45.988365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1384/2748] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:07:45 2022] POST /identity/v3/users => generated 285 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:07:45.992612 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:46.003065 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f37150f-10be-46da-ab8d-45413f599771 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:46.007807 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:46.008434 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.008743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.009037 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.009679 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:46.011284 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:46.022677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1365/2749] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:46.026656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:46.037387 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2924e0a-4e36-48b8-8574-8ad4e5d7cfb0 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:46.043410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15112cd0-7438-4525-bb41-bcffe7f1ee6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:46.044315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112cd0-7438-4525-bb41-bcffe7f1ee6e admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.044669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112cd0-7438-4525-bb41-bcffe7f1ee6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.044952 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15112cd0-7438-4525-bb41-bcffe7f1ee6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.045607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15112cd0-7438-4525-bb41-bcffe7f1ee6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:46.047813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15112cd0-7438-4525-bb41-bcffe7f1ee6e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:46.058854 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1385/2750] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:07:46 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:07:46.063555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:46.073464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf6e391-dd2e-4859-9605-7a0ca5e517d3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:46.078634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:46.079263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.079541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.079813 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] PATH_INFO: `/v3/projects/1bccb85793494d5f9ff18ffaaef821f7/users/51185edce0da4a9c840be851a05f4888/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.094033 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] RBAC: Authorizing `identity:create_grant(project_id=1bccb85793494d5f9ff18ffaaef821f7, user_id=51185edce0da4a9c840be851a05f4888, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:46.096683 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:46.109103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1366/2751] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:07:46 2022] PUT /identity/v3/projects/1bccb85793494d5f9ff18ffaaef821f7/users/51185edce0da4a9c840be851a05f4888/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:07:46.119563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.120074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.120210 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.150411 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] MFA Rules not processed for user `51185edce0da4a9c840be851a05f4888`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:07:46.151663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:46.215132 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1386/2752] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:07:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:07:46.226735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:07:46.228531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:07:46.284818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9606bf91-2563-4e08-88d4-e1a2884f6efb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:07:46.288397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0db9ac3-07c8-4b44-9d10-6c98c04d4837 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '85776df9b5714c989ae89e7103e309d5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:07:46.288996 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db9ac3-07c8-4b44-9d10-6c98c04d4837 service glance] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:07:46.289276 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db9ac3-07c8-4b44-9d10-6c98c04d4837 service glance] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:07:46.289551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0db9ac3-07c8-4b44-9d10-6c98c04d4837 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:07:46.297784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db9ac3-07c8-4b44-9d10-6c98c04d4837 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:07:46.299198 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0db9ac3-07c8-4b44-9d10-6c98c04d4837 service glance] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:07:46.307971 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1367/2753] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:07:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:07:56.212171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=54,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:07:56.304007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:09.070185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:09.132429 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5334de-18de-4373-b6dd-2d485d996a32 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:09.136946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:09.137570 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.137850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.138120 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] PATH_INFO: `/v3/users/51185edce0da4a9c840be851a05f4888` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.139227 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51185edce0da4a9c840be851a05f4888)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:09.141172 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:09.187003 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51185edce0da4a9c840be851a05f4888'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:09.187575 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51185edce0da4a9c840be851a05f4888'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:09.194702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51185edce0da4a9c840be851a05f4888'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:09.201913 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51185edce0da4a9c840be851a05f4888'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:09.213722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51185edce0da4a9c840be851a05f4888'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:09.219511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1387/2754] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:08:09 2022] DELETE /identity/v3/users/51185edce0da4a9c840be851a05f4888 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:09.224526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.225073 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.225179 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.244333 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:09.245553 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:09.304880 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1368/2755] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:08:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:09.314504 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:09.315917 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:09.372619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18a3d67-7b15-45ce-9955-4779b50eb434 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:09.376195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45a2437-792f-488f-bb9b-33fe63f219b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:09.376787 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2437-792f-488f-bb9b-33fe63f219b0 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.377063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2437-792f-488f-bb9b-33fe63f219b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.377331 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45a2437-792f-488f-bb9b-33fe63f219b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.386155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2437-792f-488f-bb9b-33fe63f219b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:09.387567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c45a2437-792f-488f-bb9b-33fe63f219b0 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:09.396903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1388/2756] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:09.931726 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:09.933174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:09.946812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18afe0f-5b31-4bc9-939f-af2e68782981 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:09.952277 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:09.952919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:09.953818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:09.953818 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] PATH_INFO: `/v3/projects/1bccb85793494d5f9ff18ffaaef821f7` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:09.954572 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1bccb85793494d5f9ff18ffaaef821f7)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:09.960229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.009856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1bccb85793494d5f9ff18ffaaef821f7', 'request_id': 'req-9668108d-e76f-48ff-a034-9b79f98f8529'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.015330 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1bccb85793494d5f9ff18ffaaef821f7', 'request_id': 'req-9668108d-e76f-48ff-a034-9b79f98f8529'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.022160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1bccb85793494d5f9ff18ffaaef821f7', 'request_id': 'req-9668108d-e76f-48ff-a034-9b79f98f8529'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.034885 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] The token cache is being invalidate because project 1bccb85793494d5f9ff18ffaaef821f7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:10.035174 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.035806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-9668108d-e76f-48ff-a034-9b79f98f8529 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.037483 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1369/2757] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:09 2022] DELETE /identity/v3/projects/1bccb85793494d5f9ff18ffaaef821f7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:10.042369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.042681 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.042988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.062147 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:10.063337 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.080273 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:10.124101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1389/2758] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:10.133503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.133790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.134063 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.154224 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:10.155410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.163816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1370/2759] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:10.168081 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.178406 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fae64de-a09c-401c-a899-a1eebbdcd33d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.182907 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.183500 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.183775 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.184075 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.184716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:08:10.185015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.186590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.197957 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1390/2760] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:08:10.202228 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.211385 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed65a60-bc99-456c-9a6a-4686a0bbed87 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.215974 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.216592 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.216872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.217140 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.217743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.219606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.250339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1371/2761] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/projects => generated 373 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:08:10.251499 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.262209 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a5a77f-0b4d-4f90-8fcc-d53ac7dfe279 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.317960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.318557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.318879 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.319155 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.319793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.321755 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.343140 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1391/2762] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:08:10.346548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.357710 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b01f188b-fb57-4c78-8e9d-326cf106f291 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.362245 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.362828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.363108 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.363377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.364008 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.365856 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.375743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1372/2763] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:08:10.379485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.389583 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b9a238-ce4f-46fb-af94-502a88368035 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.394220 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e422afb-9f22-4c4b-8d25-484d804c35cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.394942 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422afb-9f22-4c4b-8d25-484d804c35cc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.395076 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422afb-9f22-4c4b-8d25-484d804c35cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.395356 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e422afb-9f22-4c4b-8d25-484d804c35cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.396564 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e422afb-9f22-4c4b-8d25-484d804c35cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.398165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e422afb-9f22-4c4b-8d25-484d804c35cc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.408514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1392/2764] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:08:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:08:10.413211 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.423191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264e68ed-1212-421b-9e7f-e519308b30e7 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.427948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.428682 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.428916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.429193 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] PATH_INFO: `/v3/projects/8bebcfccd5ef456ca3397e84378bba19/users/b061adddee1d43259def0a8402abd230/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.443594 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bebcfccd5ef456ca3397e84378bba19, user_id=b061adddee1d43259def0a8402abd230, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.446256 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.459915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1373/2765] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:08:10 2022] PUT /identity/v3/projects/8bebcfccd5ef456ca3397e84378bba19/users/b061adddee1d43259def0a8402abd230/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:10.470101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.470388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.470662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.499493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] MFA Rules not processed for user `b061adddee1d43259def0a8402abd230`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:10.500742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.564247 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1393/2766] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:10.575757 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.577603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.600297 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:10.636672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9573c798-4134-4dde-ab06-2007a39c0ee4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.640299 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433970b3-da62-4663-9af6-c125430470f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.640902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433970b3-da62-4663-9af6-c125430470f1 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.641181 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433970b3-da62-4663-9af6-c125430470f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.641455 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433970b3-da62-4663-9af6-c125430470f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.650616 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433970b3-da62-4663-9af6-c125430470f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.652034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433970b3-da62-4663-9af6-c125430470f1 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.660783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1374/2767] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:10.689919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.710039 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:10.754484 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c822a8b9-022b-4cd6-ac8c-62606ecfc6e1 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:10.759790 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:10.760440 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.760722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.760997 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] PATH_INFO: `/v3/users/b061adddee1d43259def0a8402abd230` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.762131 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] RBAC: Authorizing `identity:delete_user(user_id=b061adddee1d43259def0a8402abd230)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:10.764052 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:10.809863 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b061adddee1d43259def0a8402abd230'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.810529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b061adddee1d43259def0a8402abd230'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.817841 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b061adddee1d43259def0a8402abd230'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.825410 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b061adddee1d43259def0a8402abd230'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.837815 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b061adddee1d43259def0a8402abd230'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:10.843965 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1394/2768] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:08:10 2022] DELETE /identity/v3/users/b061adddee1d43259def0a8402abd230 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:10.848462 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:10.848746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:10.849024 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:10.867677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:10.869156 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.929741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1375/2769] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:08:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:10.939680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:10.941105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:10.999222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5299fa2-3a56-40db-bbcf-0ebde26d5bad admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:11.002848 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e56f10a-1e2d-48e0-b295-896237eb3dc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:11.003454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56f10a-1e2d-48e0-b295-896237eb3dc1 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.003736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56f10a-1e2d-48e0-b295-896237eb3dc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.004009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e56f10a-1e2d-48e0-b295-896237eb3dc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.014281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56f10a-1e2d-48e0-b295-896237eb3dc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:11.015756 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e56f10a-1e2d-48e0-b295-896237eb3dc1 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:11.025646 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1395/2770] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:08:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:08:11.292340 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:08:11.293923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:11.306708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66135ae-a280-4fb7-8f31-570bbc2931b9 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:08:11.311318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:08:11.311949 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:11.312263 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:11.312534 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] PATH_INFO: `/v3/projects/8bebcfccd5ef456ca3397e84378bba19` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:11.313644 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bebcfccd5ef456ca3397e84378bba19)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:08:11.315598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:08:11.363514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bebcfccd5ef456ca3397e84378bba19', 'request_id': 'req-3760909d-04cf-4046-960f-9699b9b985e5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.369859 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bebcfccd5ef456ca3397e84378bba19', 'request_id': 'req-3760909d-04cf-4046-960f-9699b9b985e5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.376528 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bebcfccd5ef456ca3397e84378bba19', 'request_id': 'req-3760909d-04cf-4046-960f-9699b9b985e5'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.390132 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] The token cache is being invalidate because project 8bebcfccd5ef456ca3397e84378bba19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:08:11.390446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.391078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:08:11.392557 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1376/2771] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:08:11 2022] DELETE /identity/v3/projects/8bebcfccd5ef456ca3397e84378bba19 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:08:16.534567 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0b4c3-296f-4295-ac5c-c8364217d46f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:08:16.535011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0b4c3-296f-4295-ac5c-c8364217d46f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:08:16.535136 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bd0b4c3-296f-4295-ac5c-c8364217d46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:08:16.554486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-5bd0b4c3-296f-4295-ac5c-c8364217d46f None None] MFA Rules not processed for user `7e1f6c32f8ce4b579dbbb1ab2a138745`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:08:16.555677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-5bd0b4c3-296f-4295-ac5c-c8364217d46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:08:16.588950 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:16.611716 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1396/2772] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:08:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:08:21.387079 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:08:26.605032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=7 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:06.854545 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:09:06.855979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:09:07.021529 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3760909d-04cf-4046-960f-9699b9b985e5 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:09:07.027147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:09:07.027759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:07.028053 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:07.028343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:07.030103 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:09:07.042146 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:09:07.043821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbfc45d-e3d8-419d-bae4-45453c0603a7 service placement] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:09:07.054443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1377/2773] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:09:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:09:15.500011 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305031-3b8c-4cdd-9ad5-7e620fc569c6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:15.500592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305031-3b8c-4cdd-9ad5-7e620fc569c6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:15.500592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53305031-3b8c-4cdd-9ad5-7e620fc569c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:15.519635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-53305031-3b8c-4cdd-9ad5-7e620fc569c6 None None] MFA Rules not processed for user `7e1f6c32f8ce4b579dbbb1ab2a138745`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:09:15.520874 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-53305031-3b8c-4cdd-9ad5-7e620fc569c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:09:15.527816 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1397/2774] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:09:15 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:09:17.050647 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=63 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:25.514540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:43.478368 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac0e4-1c9a-43a8-8d46-3fa295f7100d None None] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:43.478981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac0e4-1c9a-43a8-8d46-3fa295f7100d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:43.478981 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cac0e4-1c9a-43a8-8d46-3fa295f7100d None None] PATH_INFO: `/` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:43.480496 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1378/2775] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:09:43.486686 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af72d7-871b-4e00-8ed9-f8d114e3a65a None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:43.487183 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af72d7-871b-4e00-8ed9-f8d114e3a65a None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:43.487296 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98af72d7-871b-4e00-8ed9-f8d114e3a65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:43.540849 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-98af72d7-871b-4e00-8ed9-f8d114e3a65a None None] MFA Rules not processed for user `084559c0a60c45bbad27051a12a4f3a3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:09:43.542101 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-98af72d7-871b-4e00-8ed9-f8d114e3a65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:09:43.605776 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1398/2776] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:09:43 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:09:43.622044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cac0e4-1c9a-43a8-8d46-3fa295f7100d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:09:43.623871 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d4cac0e4-1c9a-43a8-8d46-3fa295f7100d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:09:43.637516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cac0e4-1c9a-43a8-8d46-3fa295f7100d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:09:43.641123 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3357d6bd-be8b-4856-a019-e1a19e35113c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:09:43.641716 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d6bd-be8b-4856-a019-e1a19e35113c service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:43.641989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d6bd-be8b-4856-a019-e1a19e35113c service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:43.642260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3357d6bd-be8b-4856-a019-e1a19e35113c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:43.649375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357d6bd-be8b-4856-a019-e1a19e35113c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:09:43.650630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3357d6bd-be8b-4856-a019-e1a19e35113c service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:09:43.658319 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1379/2777] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:09:43 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:09:43.739523 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5a157-4300-4fce-835e-a63d6804aad7 None None] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:43.739812 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5a157-4300-4fce-835e-a63d6804aad7 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:43.740123 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d5a157-4300-4fce-835e-a63d6804aad7 None None] PATH_INFO: `/` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:43.741741 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1399/2778] 10.222.0.72 () {54 vars in 921 bytes} [Thu Aug 25 03:09:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 25 03:09:43.748113 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13869049-2256-4498-802b-f91f16b97b90 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:43.748397 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13869049-2256-4498-802b-f91f16b97b90 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:43.748693 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13869049-2256-4498-802b-f91f16b97b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:43.779361 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-13869049-2256-4498-802b-f91f16b97b90 None None] MFA Rules not processed for user `a4e5a17f91134c59bec66f04a175ef05`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:09:43.780576 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-13869049-2256-4498-802b-f91f16b97b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:09:43.862116 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1380/2779] 10.222.0.72 () {58 vars in 1018 bytes} [Thu Aug 25 03:09:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:09:43.873557 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5a157-4300-4fce-835e-a63d6804aad7 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:09:43.884305 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d5a157-4300-4fce-835e-a63d6804aad7 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:09:43.887799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:09:43.888425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:09:43.888703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:09:43.888974 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:09:43.898610 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:09:43.900022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:09:43.910425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1400/2780] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:09:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:09:53.859195 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=49 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:09:53.905918 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=46 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:12.600833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:12.601351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:12.601351 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:12.620513 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] MFA Rules not processed for user `7e1f6c32f8ce4b579dbbb1ab2a138745`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:10:12.621786 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:12.628670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1381/2781] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:10:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:10:22.615578 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:10:59.884798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:10:59.886190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:59.964032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fbeca3-6076-4238-af62-06a6847d6dda service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:10:59.967614 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:10:59.968248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:10:59.968528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:10:59.968800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:10:59.970510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:10:59.983737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:10:59.985200 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:10:59.996325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1401/2782] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:10:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:01.561291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:01.571418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d1a510-a8ac-42fc-892c-34cda1966b88 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:01.574952 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:01.575550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:01.575827 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:01.576137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:01.578744 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:01.592482 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:01.594025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:01.604860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1382/2783] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:01 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:04.789325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:04.789930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:04.801672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2e33d2-7874-4745-afdb-18c31b893b11 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:04.805417 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:04.807384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:04.807384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:04.807384 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:04.808714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:04.819340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:04.820842 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:04.830563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1402/2784] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:04 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:11.600075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:14.825877 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=41 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:15.605212 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:15.606675 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:15.723213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db1756-83fc-4086-b122-54dec03ef488 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:15.727687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:15.728350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:15.728625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:15.728896 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] PATH_INFO: `/v3/users/3303c146b3c64b2ebace2f9dcfa4f445` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:15.730069 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3303c146b3c64b2ebace2f9dcfa4f445)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:15.731975 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:15.802004 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3303c146b3c64b2ebace2f9dcfa4f445'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:15.802714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3303c146b3c64b2ebace2f9dcfa4f445'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:15.821410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3303c146b3c64b2ebace2f9dcfa4f445'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:15.831062 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3303c146b3c64b2ebace2f9dcfa4f445'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:15.840301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3303c146b3c64b2ebace2f9dcfa4f445'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:15.849410 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1383/2785] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:15 2022] DELETE /identity/v3/users/3303c146b3c64b2ebace2f9dcfa4f445 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:16.050525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:16.078896 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71693d3-899f-48be-a815-263c370e0088 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:16.151111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:16.151747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:16.152023 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:16.152321 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] PATH_INFO: `/v3/projects/784f7c8aff1045d89976fc42f1ef9593` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:16.153456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=784f7c8aff1045d89976fc42f1ef9593)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:16.155617 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:16.211462 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '784f7c8aff1045d89976fc42f1ef9593', 'request_id': 'req-809aea64-30e9-487f-b5b8-0906314440d3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.219105 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '784f7c8aff1045d89976fc42f1ef9593', 'request_id': 'req-809aea64-30e9-487f-b5b8-0906314440d3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.228605 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '784f7c8aff1045d89976fc42f1ef9593', 'request_id': 'req-809aea64-30e9-487f-b5b8-0906314440d3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.245446 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] The token cache is being invalidate because project 784f7c8aff1045d89976fc42f1ef9593 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:16.245979 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.246868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.249797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1403/2786] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:16 2022] DELETE /identity/v3/projects/784f7c8aff1045d89976fc42f1ef9593 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:16.253773 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:16.255532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:16.271801 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb686ed1-6cbe-4226-8ec2-6165e3824700 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:16.323905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:16.335857 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:16.336708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:16.337110 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:16.337614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] PATH_INFO: `/v3/users/d956343810a948f0929546994038017f` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:16.338864 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=d956343810a948f0929546994038017f)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:16.340898 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:16.391657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd956343810a948f0929546994038017f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.392426 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd956343810a948f0929546994038017f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.404865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd956343810a948f0929546994038017f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.412443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd956343810a948f0929546994038017f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.419478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd956343810a948f0929546994038017f'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.426638 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1384/2787] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:16 2022] DELETE /identity/v3/users/d956343810a948f0929546994038017f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:16.613798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:16.615253 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:16.635171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809aea64-30e9-487f-b5b8-0906314440d3 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:16.712433 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:16.713113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:16.713454 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:16.713734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] PATH_INFO: `/v3/projects/60288d533f894036a1f2615dcb2c6906` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:16.714846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=60288d533f894036a1f2615dcb2c6906)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:16.716840 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:16.754780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:16.771774 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '60288d533f894036a1f2615dcb2c6906', 'request_id': 'req-221301b1-2716-43ed-930a-38d59c7832c7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.777425 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '60288d533f894036a1f2615dcb2c6906', 'request_id': 'req-221301b1-2716-43ed-930a-38d59c7832c7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.785016 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '60288d533f894036a1f2615dcb2c6906', 'request_id': 'req-221301b1-2716-43ed-930a-38d59c7832c7'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.797855 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] The token cache is being invalidate because project 60288d533f894036a1f2615dcb2c6906 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:16.800930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.800930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:16.801421 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1404/2788] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:16 2022] DELETE /identity/v3/projects/60288d533f894036a1f2615dcb2c6906 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:17.424563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:17.426052 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:17.439961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eeb903d-60a4-42a0-813d-e8022d6d63fe admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:17.497826 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:17.498598 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:17.498874 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:17.499147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] PATH_INFO: `/v3/users/7e1f6c32f8ce4b579dbbb1ab2a138745` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:17.500298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e1f6c32f8ce4b579dbbb1ab2a138745)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:17.502196 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:17.550907 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e1f6c32f8ce4b579dbbb1ab2a138745'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.551551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e1f6c32f8ce4b579dbbb1ab2a138745'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.566661 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e1f6c32f8ce4b579dbbb1ab2a138745'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.574301 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e1f6c32f8ce4b579dbbb1ab2a138745'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.575657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:17.584672 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-a16cb3b7-1a5f-4b60-97dd-5518e4d4fba3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e1f6c32f8ce4b579dbbb1ab2a138745'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.590752 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1385/2789] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:17 2022] DELETE /identity/v3/users/7e1f6c32f8ce4b579dbbb1ab2a138745 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:17.759985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:17.761483 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:17.778083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221301b1-2716-43ed-930a-38d59c7832c7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:17.843110 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:17.843746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:17.844027 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:17.844338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] PATH_INFO: `/v3/projects/7442432ddec74c198af8e11647393730` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:17.845456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7442432ddec74c198af8e11647393730)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:17.847347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:17.893969 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7442432ddec74c198af8e11647393730', 'request_id': 'req-819bb82f-0751-4cba-9544-1ceee6f9e937'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.899460 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7442432ddec74c198af8e11647393730', 'request_id': 'req-819bb82f-0751-4cba-9544-1ceee6f9e937'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.907744 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7442432ddec74c198af8e11647393730', 'request_id': 'req-819bb82f-0751-4cba-9544-1ceee6f9e937'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.918680 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] The token cache is being invalidate because project 7442432ddec74c198af8e11647393730 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:17.918966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.919577 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-819bb82f-0751-4cba-9544-1ceee6f9e937 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:17.921821 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1405/2790] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:17 2022] DELETE /identity/v3/projects/7442432ddec74c198af8e11647393730 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:17.926900 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:17.927192 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:17.927471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:17.975910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:17.977151 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:18.035312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1386/2791] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:18.043202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.043507 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.043793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.063657 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:18.064887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:18.072670 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1406/2792] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:18.076924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.086548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3715e6-d306-454f-b8d2-173eca78b789 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.091096 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.092252 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.092535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.092808 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.093498 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:18.093747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.095321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.106725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1387/2793] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:11:18.111667 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.121125 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149c0e09-067d-42ef-b1bc-6b0d24f99fc5 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.126002 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.126623 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.126899 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.127171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.127797 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.129736 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.165308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1407/2794] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/projects => generated 379 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:18.169418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.180241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8bccbf-3a9b-4871-9ade-7b4b19acc0e8 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.237219 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.237821 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.238104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.238381 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.239011 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.240968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.262961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1388/2795] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:18.266895 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.277029 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b5f671-1f5a-4cf5-bc9b-268a05125dec admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.281773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.282360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.282637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.282909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.283600 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.285398 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.295906 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1408/2796] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:18.299686 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.309464 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15f7462-4ceb-4a7c-a240-2393dfb628fa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.314650 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ea3573-4ed8-422b-bb8b-ef9b0a07af32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.315234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea3573-4ed8-422b-bb8b-ef9b0a07af32 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.315519 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea3573-4ed8-422b-bb8b-ef9b0a07af32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.315788 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ea3573-4ed8-422b-bb8b-ef9b0a07af32 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.316461 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea3573-4ed8-422b-bb8b-ef9b0a07af32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.318040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ea3573-4ed8-422b-bb8b-ef9b0a07af32 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.328552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1389/2797] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:11:18.332909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.338116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:18.345619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1061c7b-c314-40fe-a481-5534c108cfbf admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.352012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.352728 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.353043 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.353358 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] PATH_INFO: `/v3/projects/2364a0845baf4fe9880a2d1bc8a88fba/users/de61d59a89fc4481a07eb639ce2900bf/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.368379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2364a0845baf4fe9880a2d1bc8a88fba, user_id=de61d59a89fc4481a07eb639ce2900bf, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.370970 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.383916 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1409/2798] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:18 2022] PUT /identity/v3/projects/2364a0845baf4fe9880a2d1bc8a88fba/users/de61d59a89fc4481a07eb639ce2900bf/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:18.395139 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.395419 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.395690 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.423310 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] MFA Rules not processed for user `de61d59a89fc4481a07eb639ce2900bf`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:18.424560 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:18.444735 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:18.490439 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1390/2799] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:18.495343 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.557428 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e301209-da16-42b1-bd64-e8565b40305b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.562824 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.563423 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.563702 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.563975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.564633 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.566528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.593072 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1410/2800] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/projects => generated 381 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:18.597365 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.607761 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecbc1d6-9c60-467a-98af-bf702e881411 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.663680 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.664341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.664626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.664902 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.665536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.667443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.689290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1391/2801] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/users => generated 297 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:18.693154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.703921 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a97633d-fa8f-49f8-8fd3-28768e556889 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.708537 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.709124 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.709404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.709678 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.710320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.711910 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.722448 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1411/2802] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:11:18.726711 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.736972 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeb7ddb-7f13-41bf-b283-f09e01c34ee9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.741862 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.742503 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.742785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.743060 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] PATH_INFO: `/v3/projects/fdee7549ce734efb94820c017d28681d/users/f2afd29deda44eabb991c41e82ef4705/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.757909 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee7549ce734efb94820c017d28681d, user_id=f2afd29deda44eabb991c41e82ef4705, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.760604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.774092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1392/2803] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:18 2022] PUT /identity/v3/projects/fdee7549ce734efb94820c017d28681d/users/f2afd29deda44eabb991c41e82ef4705/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:18.778201 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.789189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0b8775-2448-4dfc-9efc-f1bcbe821b28 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.845095 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7002e7-83a6-44d0-a345-de18c1781c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.845694 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7002e7-83a6-44d0-a345-de18c1781c96 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.845966 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7002e7-83a6-44d0-a345-de18c1781c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.846234 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7002e7-83a6-44d0-a345-de18c1781c96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.846869 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7002e7-83a6-44d0-a345-de18c1781c96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.848565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7002e7-83a6-44d0-a345-de18c1781c96 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.858759 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1412/2804] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:18.863082 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:18.874563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694b427-a052-4932-9612-c412abfd4c76 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:18.879269 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:18.879916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.880235 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.880509 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] PATH_INFO: `/v3/projects/fdee7549ce734efb94820c017d28681d/users/f2afd29deda44eabb991c41e82ef4705/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.882469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdee7549ce734efb94820c017d28681d, user_id=f2afd29deda44eabb991c41e82ef4705, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:18.885119 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:18.896020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1393/2805] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:18 2022] PUT /identity/v3/projects/fdee7549ce734efb94820c017d28681d/users/f2afd29deda44eabb991c41e82ef4705/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:18.906516 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:18.906808 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:18.907092 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:18.936563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] MFA Rules not processed for user `f2afd29deda44eabb991c41e82ef4705`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:18.937749 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:18.976083 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:19.007388 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1413/2806] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:18 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:19.019232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:19.020961 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:19.078978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d8f2d8-b577-41e2-b3db-18692b94d0f3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:19.082591 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:19.083182 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:19.083459 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:19.083732 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:19.092625 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:19.094044 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:19.103379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1394/2807] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:19 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:19.179865 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:19.190340 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be878c3-6f86-48f9-ba9f-97ebd2db8895 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:19.194137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55339e-9b89-4c47-9438-33fe50bc9ed7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:19.194765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55339e-9b89-4c47-9438-33fe50bc9ed7 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:19.195040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55339e-9b89-4c47-9438-33fe50bc9ed7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:19.195307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55339e-9b89-4c47-9438-33fe50bc9ed7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:19.251930 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55339e-9b89-4c47-9438-33fe50bc9ed7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:19.253444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55339e-9b89-4c47-9438-33fe50bc9ed7 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:19.262380 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1414/2808] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:19 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:26.033645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:26.052719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:26.098226 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592b52ad-0785-4d6a-85a3-2295a8bbc3c5 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:26.102729 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:26.103347 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:26.103623 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:26.103892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] PATH_INFO: `/v3/users/de61d59a89fc4481a07eb639ce2900bf` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:26.105072 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de61d59a89fc4481a07eb639ce2900bf)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:26.106953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:26.152336 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de61d59a89fc4481a07eb639ce2900bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.152919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de61d59a89fc4481a07eb639ce2900bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.165187 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de61d59a89fc4481a07eb639ce2900bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.172696 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de61d59a89fc4481a07eb639ce2900bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.179643 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de61d59a89fc4481a07eb639ce2900bf'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.185500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1395/2809] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:26 2022] DELETE /identity/v3/users/de61d59a89fc4481a07eb639ce2900bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:26.190004 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:26.190479 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:26.190584 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:26.209032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:26.210223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:26.267672 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1415/2810] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:26.277389 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:26.278812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:26.336134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dffad5-87bb-4abd-8167-fa236db25fb4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:26.339760 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:26.340391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:26.340674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:26.340950 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:26.350363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:26.351790 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:26.361798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1396/2811] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:26.630531 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:26.632383 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:26.646892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fc832c-cb9a-49e5-8442-afd1c19ad998 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:26.651626 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:26.652281 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:26.652560 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:26.652832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] PATH_INFO: `/v3/projects/2364a0845baf4fe9880a2d1bc8a88fba` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:26.653941 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] RBAC: Authorizing `identity:delete_project(project_id=2364a0845baf4fe9880a2d1bc8a88fba)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:26.655834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:26.705554 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2364a0845baf4fe9880a2d1bc8a88fba', 'request_id': 'req-4370f974-dd7b-4a63-aae1-7b4cc342045b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.711096 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2364a0845baf4fe9880a2d1bc8a88fba', 'request_id': 'req-4370f974-dd7b-4a63-aae1-7b4cc342045b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.718444 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2364a0845baf4fe9880a2d1bc8a88fba', 'request_id': 'req-4370f974-dd7b-4a63-aae1-7b4cc342045b'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.721138 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:26.732307 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] The token cache is being invalidate because project 2364a0845baf4fe9880a2d1bc8a88fba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:26.732663 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.733315 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.734836 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1416/2812] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:26 2022] DELETE /identity/v3/projects/2364a0845baf4fe9880a2d1bc8a88fba => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:26.738953 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:26.748697 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af32b237-aa1b-46a8-b639-d729bfbed191 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:26.787652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:26.806910 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:26.807555 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:26.807828 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:26.808124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] PATH_INFO: `/v3/users/f2afd29deda44eabb991c41e82ef4705` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:26.809233 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2afd29deda44eabb991c41e82ef4705)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:26.811117 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:26.856863 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2afd29deda44eabb991c41e82ef4705'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.857540 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2afd29deda44eabb991c41e82ef4705'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.870075 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2afd29deda44eabb991c41e82ef4705'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.877770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2afd29deda44eabb991c41e82ef4705'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.884570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7bcc876c-107f-4ba5-817d-61eba1171d52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2afd29deda44eabb991c41e82ef4705'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:26.890244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1397/2813] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:26 2022] DELETE /identity/v3/users/f2afd29deda44eabb991c41e82ef4705 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:27.161975 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.163496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:27.178931 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4370f974-dd7b-4a63-aae1-7b4cc342045b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.235900 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.236602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.236881 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.237104 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] PATH_INFO: `/v3/projects/fdee7549ce734efb94820c017d28681d` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.238226 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdee7549ce734efb94820c017d28681d)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.240160 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.286572 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdee7549ce734efb94820c017d28681d', 'request_id': 'req-73b6f994-8dbb-471e-9935-5d6a900f412e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:27.291923 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdee7549ce734efb94820c017d28681d', 'request_id': 'req-73b6f994-8dbb-471e-9935-5d6a900f412e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:27.299732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdee7549ce734efb94820c017d28681d', 'request_id': 'req-73b6f994-8dbb-471e-9935-5d6a900f412e'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:27.310933 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] The token cache is being invalidate because project fdee7549ce734efb94820c017d28681d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:27.311223 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:27.311853 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-73b6f994-8dbb-471e-9935-5d6a900f412e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:27.314001 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1417/2814] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:27 2022] DELETE /identity/v3/projects/fdee7549ce734efb94820c017d28681d => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:27.318879 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47386689-79b4-4784-a88f-4926f833f754 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.319345 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47386689-79b4-4784-a88f-4926f833f754 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.319443 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47386689-79b4-4784-a88f-4926f833f754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.338544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-47386689-79b4-4784-a88f-4926f833f754 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:27.339770 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-47386689-79b4-4784-a88f-4926f833f754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:27.399358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1398/2815] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:27.407707 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.407976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.408349 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.428637 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:27.429850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:27.438371 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1418/2816] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:27.444257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47386689-79b4-4784-a88f-4926f833f754 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.455287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47386689-79b4-4784-a88f-4926f833f754 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.459840 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.460465 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.460746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.461017 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.461657 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:27.461957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.463536 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.475332 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1399/2817] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:11:27.479904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.490099 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c857bc3-2a32-4212-b57c-150545df5410 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.494959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.495556 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.495838 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.496148 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.496772 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.498719 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.526211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1419/2818] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:27.530312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.540575 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04454b74-b023-4c16-b9c7-75735a620628 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.587353 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:27.602064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.602666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.602948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.603220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.603872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.605812 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.628933 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1400/2819] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/users => generated 294 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:27.633111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.643611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207ba941-f35d-41e7-8a66-935193f7d981 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.648319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.648903 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.649192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.649464 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.650112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.651712 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.662392 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1420/2820] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:27.666209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.676831 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09c8a5-8c23-4496-9284-d0e049789bc1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.681416 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a966407-66bc-49a1-81e9-0fb931342f34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.682002 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a966407-66bc-49a1-81e9-0fb931342f34 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.682281 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a966407-66bc-49a1-81e9-0fb931342f34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.682552 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a966407-66bc-49a1-81e9-0fb931342f34 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.683194 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a966407-66bc-49a1-81e9-0fb931342f34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.684797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a966407-66bc-49a1-81e9-0fb931342f34 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.695229 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1401/2821] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:27.699211 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.709727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1c414c-081f-4fcb-948c-56cc0a94d0a5 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.714370 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.715008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.715290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.715569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] PATH_INFO: `/v3/projects/fa773ebb9fb84880903d3de4e70f9197/users/a4a746490f0f45d09b43b8daff3e758a/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.730511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa773ebb9fb84880903d3de4e70f9197, user_id=a4a746490f0f45d09b43b8daff3e758a, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.733193 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.747015 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1421/2822] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:27 2022] PUT /identity/v3/projects/fa773ebb9fb84880903d3de4e70f9197/users/a4a746490f0f45d09b43b8daff3e758a/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:27.757042 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.757328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.757603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.786186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] MFA Rules not processed for user `a4a746490f0f45d09b43b8daff3e758a`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:27.787404 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:27.852360 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1402/2823] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:27.856947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.882722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:27.921222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73d5412-66e1-46c4-b5f3-3ecd45bd72c6 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:27.926451 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:27.927049 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:27.927326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:27.927597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:27.928270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:27.930157 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:27.957687 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1422/2824] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:27.961793 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:27.973278 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87e8506-4e2c-4180-88ea-f48563f3ec9d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.028418 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.028954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.029237 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.029511 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.030131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.032954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.053565 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1403/2825] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:27 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:28.057563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.068363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28c5221a-f033-45ac-862b-8725827b5a18 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.072947 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.073540 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.073819 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.074091 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.074733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.076348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.088303 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1423/2826] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:28.092307 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.103066 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3c2a1-85e4-4b08-899b-38d0a6718649 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.107673 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6483fd0-b65f-4cf1-a5a1-07397a2063b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.108291 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6483fd0-b65f-4cf1-a5a1-07397a2063b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.108574 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6483fd0-b65f-4cf1-a5a1-07397a2063b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.108849 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6483fd0-b65f-4cf1-a5a1-07397a2063b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.109535 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6483fd0-b65f-4cf1-a5a1-07397a2063b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.111115 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6483fd0-b65f-4cf1-a5a1-07397a2063b8 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.121136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1404/2827] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:28.125381 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.135040 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4ab3da5-b18e-4e1e-8380-b7968476131b admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.139635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.140332 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.141048 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.141328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] PATH_INFO: `/v3/projects/1396696ac713496585a2a85c09865b2c/users/26aebec4cdbb45cfbc143ccdcc631dbe/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.155604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1396696ac713496585a2a85c09865b2c, user_id=26aebec4cdbb45cfbc143ccdcc631dbe, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.158845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.171137 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1424/2828] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:28 2022] PUT /identity/v3/projects/1396696ac713496585a2a85c09865b2c/users/26aebec4cdbb45cfbc143ccdcc631dbe/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:28.181413 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.181706 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.181979 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.209778 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] MFA Rules not processed for user `26aebec4cdbb45cfbc143ccdcc631dbe`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:28.210988 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:28.231370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:28.280582 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1405/2829] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:28.285905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.345925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01236f2-bd3c-4c3c-8945-41e9d3c88cb7 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.350474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.351070 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.351347 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.351615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.352270 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.354149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.380745 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1425/2830] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:28 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:28.384637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.395257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ea20c-841f-42ac-a05a-6bfdf5bef256 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.451355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.451984 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.452293 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.452563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.455112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.457064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.479109 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1406/2831] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:28 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:28.484951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.495635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0835d35-2aef-4193-b1a1-7eceee5f6996 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.500985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.501643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.501920 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.502189 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.502829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.504437 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.514798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1426/2832] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:28.519748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.529712 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b51e71b-57f3-4199-8e76-4ec3bc89ce17 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.534660 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.535244 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.535551 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.535822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] PATH_INFO: `/v3/projects/fb3f3ae0137b407596f094a638f68298/users/773a7184c409469e84b73d9910ba4bd9/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.554350 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3f3ae0137b407596f094a638f68298, user_id=773a7184c409469e84b73d9910ba4bd9, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.557007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.570213 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1407/2833] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:28 2022] PUT /identity/v3/projects/fb3f3ae0137b407596f094a638f68298/users/773a7184c409469e84b73d9910ba4bd9/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:28.574191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.585112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d6bea1-beff-4e01-9ab0-26b2ee5823e8 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.637662 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:28.651878 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba875729-075f-44da-a339-48ecf42dc20f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.652527 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba875729-075f-44da-a339-48ecf42dc20f admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.652804 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba875729-075f-44da-a339-48ecf42dc20f admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.653074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba875729-075f-44da-a339-48ecf42dc20f admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.653715 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba875729-075f-44da-a339-48ecf42dc20f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.655327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba875729-075f-44da-a339-48ecf42dc20f admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.665062 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1427/2834] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:28 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:28.669241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.680005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fc9fe9-505c-4ea9-9ee4-ac9e03b6f33e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.684588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.685232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.685514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.685791 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] PATH_INFO: `/v3/projects/fb3f3ae0137b407596f094a638f68298/users/773a7184c409469e84b73d9910ba4bd9/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.688440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3f3ae0137b407596f094a638f68298, user_id=773a7184c409469e84b73d9910ba4bd9, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.691055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.703364 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1408/2835] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:28 2022] PUT /identity/v3/projects/fb3f3ae0137b407596f094a638f68298/users/773a7184c409469e84b73d9910ba4bd9/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:28.766187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.766576 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.766731 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.794386 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] MFA Rules not processed for user `773a7184c409469e84b73d9910ba4bd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:28.795525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:28.863609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1428/2836] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:28 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:28.876469 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:28.878241 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:28.934843 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13cfa9da-c7ff-4b09-879d-89cd69638e2d admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:28.939968 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:28.940618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:28.940897 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:28.941546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:28.951938 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:28.953691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:28.963191 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1409/2837] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:28 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:29.454638 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:29.456080 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:29.468729 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-445f3473-5e38-4094-8337-9e7ab6b8f45c None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:29.472238 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:29.472905 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:29.473333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:29.473508 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:29.530656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:29.532135 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:29.540802 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1429/2838] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:29 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:33.553186 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:33.561860 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f962ad5-dac7-4bbe-8390-33004cfdebc5 service cinder] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:33.565579 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-661c154e-f8a6-46c9-8236-48c72c56b3a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:33.566166 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c154e-f8a6-46c9-8236-48c72c56b3a7 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:33.566440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c154e-f8a6-46c9-8236-48c72c56b3a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:33.566708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661c154e-f8a6-46c9-8236-48c72c56b3a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:33.579220 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:33.623274 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c154e-f8a6-46c9-8236-48c72c56b3a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:33.624645 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-661c154e-f8a6-46c9-8236-48c72c56b3a7 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:33.633377 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1410/2839] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:33 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:35.693313 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:35.756475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad5d7c2-3fec-4c4b-a64a-b027772f8879 service cinder] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:35.761118 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:35.761733 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:35.762008 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:35.762283 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] PATH_INFO: `/v3/users/a4a746490f0f45d09b43b8daff3e758a` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:35.763395 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4a746490f0f45d09b43b8daff3e758a)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:35.765323 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:35.772077 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=100 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:35.816892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4a746490f0f45d09b43b8daff3e758a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:35.817544 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4a746490f0f45d09b43b8daff3e758a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:35.824850 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4a746490f0f45d09b43b8daff3e758a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:35.832722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4a746490f0f45d09b43b8daff3e758a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:35.844831 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4a746490f0f45d09b43b8daff3e758a'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:35.851308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1430/2840] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:35 2022] DELETE /identity/v3/users/a4a746490f0f45d09b43b8daff3e758a => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:35.855924 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:35.856425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:35.856533 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:35.880405 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:35.881603 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:35.939799 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1411/2841] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:35.949522 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:35.951585 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:36.008290 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7fcd2d-a39b-444e-820d-73f8aef39023 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:36.011925 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:36.012552 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:36.012837 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:36.013107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:36.022668 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:36.024112 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:36.033703 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1431/2842] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:36.295168 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:36.296606 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:36.311143 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5f7621-36b6-4fad-a331-639198fdbff8 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:36.316343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:36.316989 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:36.317783 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:36.318058 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] PATH_INFO: `/v3/projects/fa773ebb9fb84880903d3de4e70f9197` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:36.319355 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa773ebb9fb84880903d3de4e70f9197)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:36.321375 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:36.368295 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa773ebb9fb84880903d3de4e70f9197', 'request_id': 'req-05becd88-5040-4084-86fc-0119fc5747d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.373666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa773ebb9fb84880903d3de4e70f9197', 'request_id': 'req-05becd88-5040-4084-86fc-0119fc5747d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.380447 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa773ebb9fb84880903d3de4e70f9197', 'request_id': 'req-05becd88-5040-4084-86fc-0119fc5747d9'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.392654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] The token cache is being invalidate because project fa773ebb9fb84880903d3de4e70f9197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:36.392944 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.393585 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.395046 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1412/2843] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:36 2022] DELETE /identity/v3/projects/fa773ebb9fb84880903d3de4e70f9197 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:36.399113 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:36.409051 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3332bd-9295-48be-821d-295d5476e5ad service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:36.464541 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:36.465165 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:36.465447 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:36.465721 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] PATH_INFO: `/v3/users/26aebec4cdbb45cfbc143ccdcc631dbe` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:36.466826 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26aebec4cdbb45cfbc143ccdcc631dbe)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:36.468809 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:36.504073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:36.519563 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aebec4cdbb45cfbc143ccdcc631dbe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.520330 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aebec4cdbb45cfbc143ccdcc631dbe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.527992 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aebec4cdbb45cfbc143ccdcc631dbe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.536539 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aebec4cdbb45cfbc143ccdcc631dbe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.549475 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aebec4cdbb45cfbc143ccdcc631dbe'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:36.555366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1432/2844] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:36 2022] DELETE /identity/v3/users/26aebec4cdbb45cfbc143ccdcc631dbe => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:37.055741 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:37.057249 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:37.071197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05becd88-5040-4084-86fc-0119fc5747d9 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:37.110366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:37.131392 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:37.132021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.132328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.132601 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] PATH_INFO: `/v3/projects/1396696ac713496585a2a85c09865b2c` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.133708 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1396696ac713496585a2a85c09865b2c)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:37.135587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:37.181176 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1396696ac713496585a2a85c09865b2c', 'request_id': 'req-b3d37e72-812a-47b6-b503-9595409a3518'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.186604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1396696ac713496585a2a85c09865b2c', 'request_id': 'req-b3d37e72-812a-47b6-b503-9595409a3518'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.193415 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1396696ac713496585a2a85c09865b2c', 'request_id': 'req-b3d37e72-812a-47b6-b503-9595409a3518'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.205471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] The token cache is being invalidate because project 1396696ac713496585a2a85c09865b2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:37.205759 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.206398 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.207917 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1413/2845] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:37 2022] DELETE /identity/v3/projects/1396696ac713496585a2a85c09865b2c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:37.211868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:37.213351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:37.225940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272cab43-d6c5-4092-9972-fa7f8ee43a59 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:37.282278 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:37.283488 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.283765 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.284032 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] PATH_INFO: `/v3/users/773a7184c409469e84b73d9910ba4bd9` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.285171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] RBAC: Authorizing `identity:delete_user(user_id=773a7184c409469e84b73d9910ba4bd9)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:37.287060 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:37.333357 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '773a7184c409469e84b73d9910ba4bd9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.334007 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '773a7184c409469e84b73d9910ba4bd9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.341496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '773a7184c409469e84b73d9910ba4bd9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.349519 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '773a7184c409469e84b73d9910ba4bd9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.362010 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-db74f508-8c33-4f53-878c-9f016707703d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '773a7184c409469e84b73d9910ba4bd9'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.368174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1433/2846] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:37 2022] DELETE /identity/v3/users/773a7184c409469e84b73d9910ba4bd9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:37.640010 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:37.642605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:37.656478 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d37e72-812a-47b6-b503-9595409a3518 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:37.712391 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:37.713014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.713290 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.713561 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] PATH_INFO: `/v3/projects/fb3f3ae0137b407596f094a638f68298` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.714658 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3f3ae0137b407596f094a638f68298)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:37.716570 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:37.763092 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3f3ae0137b407596f094a638f68298', 'request_id': 'req-758b1b93-80c8-451a-a84b-57e1bc842300'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.769734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3f3ae0137b407596f094a638f68298', 'request_id': 'req-758b1b93-80c8-451a-a84b-57e1bc842300'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.775851 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3f3ae0137b407596f094a638f68298', 'request_id': 'req-758b1b93-80c8-451a-a84b-57e1bc842300'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.785758 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:37.790091 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] The token cache is being invalidate because project fb3f3ae0137b407596f094a638f68298 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:37.790573 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.791617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-758b1b93-80c8-451a-a84b-57e1bc842300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:37.793322 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1414/2847] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:37 2022] DELETE /identity/v3/projects/fb3f3ae0137b407596f094a638f68298 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:37.799327 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.799609 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.799951 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.818960 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:37.820277 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:37.840654 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:37.880904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1434/2848] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:37.893958 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364b34-267c-4355-b97d-0022a41493ed None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.894232 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364b34-267c-4355-b97d-0022a41493ed None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.894501 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06364b34-267c-4355-b97d-0022a41493ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.914618 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-06364b34-267c-4355-b97d-0022a41493ed None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:37.915806 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-06364b34-267c-4355-b97d-0022a41493ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:37.923746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1415/2849] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:37.928056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:37.938022 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9718bcf5-f166-4c69-8329-5d7605549c6f None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:37.942813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:37.943592 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.943883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.944179 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.944843 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:37.945143 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:37.946725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:37.959338 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1435/2850] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:11:37.963936 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364b34-267c-4355-b97d-0022a41493ed None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:37.973816 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06364b34-267c-4355-b97d-0022a41493ed None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:37.978472 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:37.979327 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:37.979617 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:37.979892 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:37.980547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:37.982547 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.010366 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1416/2851] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:37 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:38.014547 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.025056 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a3e7d-0ec7-44b7-8c77-44388a687787 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.078635 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.079231 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.079512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.079777 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.081171 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.083065 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.103503 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1436/2852] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:38 2022] POST /identity/v3/users => generated 293 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:38.107654 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.118147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff154f24-73ba-4a09-b818-81097dea74e4 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.122666 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.123250 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.123526 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.123794 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.124467 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.126030 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.136257 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1417/2853] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:38.139990 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.150320 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dda0960-8b2b-4302-8b98-5d484e35682d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.154868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ee5991-4e9d-484f-8632-45ee972b15cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.155458 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee5991-4e9d-484f-8632-45ee972b15cc admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.155734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee5991-4e9d-484f-8632-45ee972b15cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.156006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ee5991-4e9d-484f-8632-45ee972b15cc admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.156669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee5991-4e9d-484f-8632-45ee972b15cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.158793 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ee5991-4e9d-484f-8632-45ee972b15cc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.169293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1437/2854] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:38.173414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.183715 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e63e402-7669-4031-977f-b985aa68c62e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.188312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.188945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.189222 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.189514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] PATH_INFO: `/v3/projects/86024fb2dcea44189a9ea415f3591459/users/227a7aa95e2344c78a4036892ad577e1/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.204590 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=86024fb2dcea44189a9ea415f3591459, user_id=227a7aa95e2344c78a4036892ad577e1, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.208566 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.220787 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1418/2855] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:38 2022] PUT /identity/v3/projects/86024fb2dcea44189a9ea415f3591459/users/227a7aa95e2344c78a4036892ad577e1/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:38.232063 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f428e-9e81-4add-8010-25b72724f5da None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.232542 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f428e-9e81-4add-8010-25b72724f5da None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.232650 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039f428e-9e81-4add-8010-25b72724f5da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.261324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-039f428e-9e81-4add-8010-25b72724f5da None None] MFA Rules not processed for user `227a7aa95e2344c78a4036892ad577e1`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:38.262535 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-039f428e-9e81-4add-8010-25b72724f5da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:38.325796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1438/2856] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:38.330287 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.392101 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edaeb44-3fb7-4491-9c69-081f589994ea admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.397172 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.397774 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.398056 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.398331 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.398986 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.401055 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.429260 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1419/2857] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:38 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:38.432082 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f428e-9e81-4add-8010-25b72724f5da None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.442846 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039f428e-9e81-4add-8010-25b72724f5da None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.461641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:38.501757 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.502419 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.502700 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.502976 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.503636 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.505589 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.527511 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1439/2858] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:38 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:38.531586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.542512 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b9200-1863-4f8d-ade7-bedc881b66cb admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.547308 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.547906 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.548217 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.548493 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.549236 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.550817 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.561309 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1420/2859] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:38.565366 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.575326 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da649664-4402-4fa2-9ca3-59db84c31bc1 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.579886 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.581117 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.581396 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.581669 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] PATH_INFO: `/v3/projects/5c06a2605213427a93479938c349df73/users/07131c9748af4a8abdd97ef551e23e37/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.596919 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c06a2605213427a93479938c349df73, user_id=07131c9748af4a8abdd97ef551e23e37, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.599619 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.612825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1440/2860] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:38 2022] PUT /identity/v3/projects/5c06a2605213427a93479938c349df73/users/07131c9748af4a8abdd97ef551e23e37/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:38.617087 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.627215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92796589-5d0f-45bc-8c5b-77a1542cf561 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.684164 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb31c419-58c6-4250-8d0a-2840d44fa53d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.684687 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31c419-58c6-4250-8d0a-2840d44fa53d admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.684966 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31c419-58c6-4250-8d0a-2840d44fa53d admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.685239 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb31c419-58c6-4250-8d0a-2840d44fa53d admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.685873 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31c419-58c6-4250-8d0a-2840d44fa53d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.687456 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb31c419-58c6-4250-8d0a-2840d44fa53d admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.697767 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1421/2861] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:38 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:38.701872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.711996 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242ed3a8-f196-4ae2-978d-4319b1051e31 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.716553 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.717195 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.717474 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.717746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] PATH_INFO: `/v3/projects/5c06a2605213427a93479938c349df73/users/07131c9748af4a8abdd97ef551e23e37/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.719641 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5c06a2605213427a93479938c349df73, user_id=07131c9748af4a8abdd97ef551e23e37, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.722367 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.732363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1441/2862] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:38 2022] PUT /identity/v3/projects/5c06a2605213427a93479938c349df73/users/07131c9748af4a8abdd97ef551e23e37/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:38.744497 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9797de-3797-4261-8e17-187b71517edc None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.744784 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9797de-3797-4261-8e17-187b71517edc None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.745059 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9797de-3797-4261-8e17-187b71517edc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.759302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:38.773742 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-be9797de-3797-4261-8e17-187b71517edc None None] MFA Rules not processed for user `07131c9748af4a8abdd97ef551e23e37`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:38.774946 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-be9797de-3797-4261-8e17-187b71517edc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:38.841980 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1422/2863] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:38 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:38.853471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:38.855161 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:38.914771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4b8ec9-f1a5-40c8-8d62-4f9761ac1a98 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:38.918325 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6aaa654-f840-43d6-9c42-9351e0b11cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:38.918926 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa654-f840-43d6-9c42-9351e0b11cbd service cinder] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:38.919202 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa654-f840-43d6-9c42-9351e0b11cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:38.919471 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aaa654-f840-43d6-9c42-9351e0b11cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:38.929107 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaa654-f840-43d6-9c42-9351e0b11cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:38.930525 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6aaa654-f840-43d6-9c42-9351e0b11cbd service cinder] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:38.944832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1442/2864] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:38 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:39.524358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9797de-3797-4261-8e17-187b71517edc None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:39.595798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9797de-3797-4261-8e17-187b71517edc None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:39.601994 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:39.602629 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:39.602903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:39.603200 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] PATH_INFO: `/v3/users/227a7aa95e2344c78a4036892ad577e1` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:39.604407 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] RBAC: Authorizing `identity:delete_user(user_id=227a7aa95e2344c78a4036892ad577e1)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:39.606304 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:39.653372 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '227a7aa95e2344c78a4036892ad577e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:39.654016 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '227a7aa95e2344c78a4036892ad577e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:39.665662 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '227a7aa95e2344c78a4036892ad577e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:39.673093 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '227a7aa95e2344c78a4036892ad577e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:39.680160 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '227a7aa95e2344c78a4036892ad577e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:39.685833 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1423/2865] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:39 2022] DELETE /identity/v3/users/227a7aa95e2344c78a4036892ad577e1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:39.691256 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:39.691747 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:39.691844 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:39.834649 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:39.835872 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:39.894154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1443/2866] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:39.903919 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:39.905358 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:39.919314 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:39.966747 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c39ec5d-8c80-44ab-8f12-73d6e6ce6307 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:39.970387 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:39.971610 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:39.972104 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:39.972388 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:39.981370 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:39.982785 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:39.992651 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1424/2867] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:40.260006 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:40.261640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:40.275491 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa997a-0b0f-4cda-b2a0-37463ee73c95 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:40.280069 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:40.280710 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:40.280985 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:40.281308 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] PATH_INFO: `/v3/projects/86024fb2dcea44189a9ea415f3591459` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:40.282360 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=86024fb2dcea44189a9ea415f3591459)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:40.285073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:40.296607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:40.332835 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86024fb2dcea44189a9ea415f3591459', 'request_id': 'req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.338293 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86024fb2dcea44189a9ea415f3591459', 'request_id': 'req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.345414 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86024fb2dcea44189a9ea415f3591459', 'request_id': 'req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.356825 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] The token cache is being invalidate because project 86024fb2dcea44189a9ea415f3591459 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:40.357106 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.357725 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.359176 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1444/2868] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:40 2022] DELETE /identity/v3/projects/86024fb2dcea44189a9ea415f3591459 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:40.363298 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:40.373095 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8861a28-1619-43c5-b697-7a11f08f8864 service neutron] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:40.429090 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:40.429709 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:40.429990 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:40.430261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] PATH_INFO: `/v3/users/07131c9748af4a8abdd97ef551e23e37` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:40.431393 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] RBAC: Authorizing `identity:delete_user(user_id=07131c9748af4a8abdd97ef551e23e37)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:40.433349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:40.478704 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '07131c9748af4a8abdd97ef551e23e37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.479363 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '07131c9748af4a8abdd97ef551e23e37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.491253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '07131c9748af4a8abdd97ef551e23e37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.499396 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '07131c9748af4a8abdd97ef551e23e37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.507038 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-60fb8c88-9c74-4245-81c2-2270d1bda78a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '07131c9748af4a8abdd97ef551e23e37'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.512872 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1425/2869] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:40 2022] DELETE /identity/v3/users/07131c9748af4a8abdd97ef551e23e37 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:40.781945 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:40.783683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:40.796738 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235ddaaf-70e8-4bd8-8d18-883ebe1885ec admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:40.855191 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:40.855732 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:40.856009 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:40.856322 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] PATH_INFO: `/v3/projects/5c06a2605213427a93479938c349df73` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:40.857407 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5c06a2605213427a93479938c349df73)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:40.859352 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:40.904940 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5c06a2605213427a93479938c349df73', 'request_id': 'req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.910656 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5c06a2605213427a93479938c349df73', 'request_id': 'req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.917834 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5c06a2605213427a93479938c349df73', 'request_id': 'req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.929328 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] The token cache is being invalidate because project 5c06a2605213427a93479938c349df73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81633) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:40.929615 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.930248 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-e0c9ed2e-199c-45fb-8719-fc3b974fd51d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:40.931720 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1445/2870] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:40 2022] DELETE /identity/v3/projects/5c06a2605213427a93479938c349df73 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:40.940634 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:40.941141 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:40.941727 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:40.961349 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:40.962546 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:40.991238 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:41.026725 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1426/2871] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:41.035000 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.035309 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.035590 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.055473 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:41.056714 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:41.064607 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1446/2872] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:41.068891 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.078302 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cb40b2-8eff-4485-92c1-725159d67dd4 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.083339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.083923 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.084234 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.084514 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] PATH_INFO: `/v3/domains` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.085137 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:41.085435 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.087005 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.099097 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1427/2873] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 25 03:11:41.103459 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.113569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87328e3-fbf1-45ff-b031-d9cd9c78ea33 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.118467 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.119055 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.119333 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.119602 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.120261 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.122142 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.149190 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1447/2874] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/projects => generated 379 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:41.153406 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.163753 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ad44cf-e4f1-4f4c-8433-da379832c775 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.217734 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.218325 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.218604 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.218878 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.219485 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.221920 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.243124 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1428/2875] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/users => generated 290 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:41.247324 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.253012 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:41.259228 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e87a282-97a7-4d5d-a928-ab68086cdda2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.264742 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.265363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.265643 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.265915 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.266558 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.268229 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.278074 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1448/2876] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:41.282077 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.292420 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e619d07-bfca-4a78-bc99-fcc2cbc854dd admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.296957 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d41a25e-5a5b-43fe-a9d1-b7b75086afd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.297541 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41a25e-5a5b-43fe-a9d1-b7b75086afd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.297819 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41a25e-5a5b-43fe-a9d1-b7b75086afd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.298088 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d41a25e-5a5b-43fe-a9d1-b7b75086afd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.298718 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41a25e-5a5b-43fe-a9d1-b7b75086afd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.301071 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d41a25e-5a5b-43fe-a9d1-b7b75086afd5 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.311581 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1429/2877] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:41.315704 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.325515 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e848dcce-ddd0-49b4-83b2-7090ad36708c admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.330246 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.331279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.331555 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.331827 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] PATH_INFO: `/v3/projects/87437df51b5d4052bb4864e3949850d8/users/a5564a7fc9fb4d259ce87fafddc9f744/roles/bf081564133f4648af5314a7102589fb` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.346452 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=87437df51b5d4052bb4864e3949850d8, user_id=a5564a7fc9fb4d259ce87fafddc9f744, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.349341 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.362456 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1449/2878] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:41 2022] PUT /identity/v3/projects/87437df51b5d4052bb4864e3949850d8/users/a5564a7fc9fb4d259ce87fafddc9f744/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:41.374218 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.374440 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.374719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.403341 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] MFA Rules not processed for user `a5564a7fc9fb4d259ce87fafddc9f744`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:41.404596 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:41.470064 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1430/2879] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:41.475041 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.536512 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935e1e4-a105-4416-a8ad-5547ba01b9e2 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.541111 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.541706 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.541987 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.542258 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] PATH_INFO: `/v3/projects` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.542890 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.544813 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.573868 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1450/2880] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:41.578107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.588607 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95067a-e41d-4309-b779-ca90f3579c3d None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.617339 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:41.651318 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.651846 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.652157 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.652550 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] PATH_INFO: `/v3/users` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.653054 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.654978 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.675531 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1431/2881] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/users => generated 297 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:41.680021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.690902 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419ed6b4-f1a8-418e-b831-a1214834166d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.695528 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.696149 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.696430 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.696705 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.697348 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.698929 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.708991 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1451/2882] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:41.713822 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.724779 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66117bf-439f-4c85-9063-73d082d0b4fa admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.729691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.730348 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.730621 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.730889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] PATH_INFO: `/v3/projects/5f53877262d8437a913cb4b8b43ba529/users/030b53c9e6ef4c7685118c1b8791f5e3/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.751954 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f53877262d8437a913cb4b8b43ba529, user_id=030b53c9e6ef4c7685118c1b8791f5e3, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.756586 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.771542 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1432/2883] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:41 2022] PUT /identity/v3/projects/5f53877262d8437a913cb4b8b43ba529/users/030b53c9e6ef4c7685118c1b8791f5e3/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:41.775746 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.786924 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b610e4-233f-492d-a582-d9233ddd8f82 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.851529 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4071ef8-189d-40e3-a101-d1ce7d83e300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.852244 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071ef8-189d-40e3-a101-d1ce7d83e300 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.852524 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071ef8-189d-40e3-a101-d1ce7d83e300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.852791 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4071ef8-189d-40e3-a101-d1ce7d83e300 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.853432 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4071ef8-189d-40e3-a101-d1ce7d83e300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.855394 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4071ef8-189d-40e3-a101-d1ce7d83e300 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.868798 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1452/2884] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:41 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 25 03:11:41.873208 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:41.885403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852878f-7ad4-4ed4-a41b-305e1784db18 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:41.890021 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:41.890667 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.890941 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.891215 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] PATH_INFO: `/v3/projects/5f53877262d8437a913cb4b8b43ba529/users/030b53c9e6ef4c7685118c1b8791f5e3/roles/1805185e98c2434aa68c10e77ddb16ee` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.894112 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f53877262d8437a913cb4b8b43ba529, user_id=030b53c9e6ef4c7685118c1b8791f5e3, role_id=1805185e98c2434aa68c10e77ddb16ee)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:41.896889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:41.914253 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1433/2885] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:41 2022] PUT /identity/v3/projects/5f53877262d8437a913cb4b8b43ba529/users/030b53c9e6ef4c7685118c1b8791f5e3/roles/1805185e98c2434aa68c10e77ddb16ee => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:41.926404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:41.926689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:41.926961 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:41.960497 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] MFA Rules not processed for user `030b53c9e6ef4c7685118c1b8791f5e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:41.961722 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:41.990204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:42.038087 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1453/2886] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:41 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:42.049798 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:42.051820 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:42.111078 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da31ec24-3495-4efd-aa16-c1e3f645bec3 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:42.115577 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd5b364-c8c9-4b59-97b3-353569252bb8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:42.116243 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b364-c8c9-4b59-97b3-353569252bb8 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:42.116800 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b364-c8c9-4b59-97b3-353569252bb8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:42.117131 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd5b364-c8c9-4b59-97b3-353569252bb8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:42.126595 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5b364-c8c9-4b59-97b3-353569252bb8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:42.128114 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fd5b364-c8c9-4b59-97b3-353569252bb8 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:42.138838 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1434/2887] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:42 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:42.541780 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:42.602829 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899bd52e-cc63-4e18-912f-93010cd843a4 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:42.607319 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:42.607949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:42.608259 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:42.608536 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] PATH_INFO: `/v3/users/a5564a7fc9fb4d259ce87fafddc9f744` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:42.609675 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5564a7fc9fb4d259ce87fafddc9f744)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:42.611677 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:42.655771 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5564a7fc9fb4d259ce87fafddc9f744'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:42.656470 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5564a7fc9fb4d259ce87fafddc9f744'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:42.664359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5564a7fc9fb4d259ce87fafddc9f744'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:42.671604 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5564a7fc9fb4d259ce87fafddc9f744'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:42.684279 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5564a7fc9fb4d259ce87fafddc9f744'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:42.690204 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1454/2888] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:42 2022] DELETE /identity/v3/users/a5564a7fc9fb4d259ce87fafddc9f744 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:42.694630 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:42.694915 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:42.695190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:42.713771 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:42.714976 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:42.774356 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1435/2889] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:42.784799 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:42.786224 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:42.831727 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:42.844565 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63549754-c5be-4ce5-a153-2ee877a43b24 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:42.848934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:42.849568 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:42.849845 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:42.850116 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:42.859174 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:42.860640 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:42.870946 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1455/2890] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:43.134932 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:43.136500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:43.149390 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd671f86-943e-4a65-9a98-1e9945afc53f None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:43.154626 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:43.155719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.155847 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.156321 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] PATH_INFO: `/v3/projects/87437df51b5d4052bb4864e3949850d8` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.157221 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=87437df51b5d4052bb4864e3949850d8)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:43.159809 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:43.181500 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:43.207251 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87437df51b5d4052bb4864e3949850d8', 'request_id': 'req-265d865f-9e5e-436a-9f37-ac1668c8f1e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.212677 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87437df51b5d4052bb4864e3949850d8', 'request_id': 'req-265d865f-9e5e-436a-9f37-ac1668c8f1e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.218739 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87437df51b5d4052bb4864e3949850d8', 'request_id': 'req-265d865f-9e5e-436a-9f37-ac1668c8f1e1'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.231713 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] The token cache is being invalidate because project 87437df51b5d4052bb4864e3949850d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:43.232007 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.232714 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.234230 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1436/2891] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:43 2022] DELETE /identity/v3/projects/87437df51b5d4052bb4864e3949850d8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:43.238683 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:43.248569 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25530409-7a26-4002-8759-01bb3e6a244f service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:43.304073 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:43.304709 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.304988 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.305263 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] PATH_INFO: `/v3/users/030b53c9e6ef4c7685118c1b8791f5e3` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.306378 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] RBAC: Authorizing `identity:delete_user(user_id=030b53c9e6ef4c7685118c1b8791f5e3)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:43.308306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:43.353354 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '030b53c9e6ef4c7685118c1b8791f5e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.354024 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '030b53c9e6ef4c7685118c1b8791f5e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.360851 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '030b53c9e6ef4c7685118c1b8791f5e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.368814 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '030b53c9e6ef4c7685118c1b8791f5e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.380718 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-211e09d2-971a-463d-bda3-73068bcc0937 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '030b53c9e6ef4c7685118c1b8791f5e3'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.386506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1456/2892] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:43 2022] DELETE /identity/v3/users/030b53c9e6ef4c7685118c1b8791f5e3 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 25 03:11:43.655889 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:43.657587 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:43.673134 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265d865f-9e5e-436a-9f37-ac1668c8f1e1 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:43.730588 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:43.731048 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.731324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.731593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] PATH_INFO: `/v3/projects/5f53877262d8437a913cb4b8b43ba529` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.732695 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f53877262d8437a913cb4b8b43ba529)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:43.734605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:43.780593 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f53877262d8437a913cb4b8b43ba529', 'request_id': 'req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.786014 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f53877262d8437a913cb4b8b43ba529', 'request_id': 'req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.792094 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f53877262d8437a913cb4b8b43ba529', 'request_id': 'req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.804474 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] The token cache is being invalidate because project 5f53877262d8437a913cb4b8b43ba529 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:43.804789 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.805425 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-7d47287c-f1a4-4c00-ac2d-cdc17b474bb7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:43.806903 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1437/2893] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:43 2022] DELETE /identity/v3/projects/5f53877262d8437a913cb4b8b43ba529 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:43.811862 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.812185 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.812485 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.832496 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:43.833773 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:43.892215 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1457/2894] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:43.900122 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.900412 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.900691 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.920209 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:43.921414 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:43.929948 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1438/2895] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:43.934254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:43.940949 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:43.944909 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace8d4d9-f9ec-4609-a1b1-c3b2feb6c01d None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:43.950597 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:43.951486 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.951894 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.952213 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] PATH_INFO: `/v3/domains` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.952887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81633) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 25 03:11:43.953363 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:43.955306 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:43.967351 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1458/2896] 10.222.0.72 () {58 vars in 1153 bytes} [Thu Aug 25 03:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 25 03:11:43.971743 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:43.980905 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05fac44b-4840-487f-b9ff-6cbe904aecba None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:43.985446 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:43.986034 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:43.986312 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:43.987107 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] PATH_INFO: `/v3/projects` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:43.987719 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:43.989637 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:44.016960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1439/2897] 10.222.0.72 () {60 vars in 1153 bytes} [Thu Aug 25 03:11:43 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 25 03:11:44.021254 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:44.031071 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3629cb66-d52a-4d35-ba1a-2e72c1538f39 admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:44.098369 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:44.098959 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:44.099237 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:44.099506 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] PATH_INFO: `/v3/users` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:44.100139 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:44.102019 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:44.123232 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1459/2898] 10.222.0.72 () {60 vars in 1144 bytes} [Thu Aug 25 03:11:44 2022] POST /identity/v3/users => generated 289 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 25 03:11:44.127664 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:44.137965 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84a45dd-94e5-4b3d-b60b-a6d53424ef05 admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:44.142544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:44.143138 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:44.143516 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:44.143797 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] PATH_INFO: `/v3/roles` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:44.144471 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:44.146040 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:44.148118 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:44.159261 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1440/2899] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:44.163085 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:44.173021 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8beca45a-4700-4b5e-a69f-4ea043220c9d admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:44.178359 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9e33b9-e801-4e0f-8772-5cca66872c65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:44.178944 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e33b9-e801-4e0f-8772-5cca66872c65 admin admin] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:44.179222 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e33b9-e801-4e0f-8772-5cca66872c65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:44.179490 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9e33b9-e801-4e0f-8772-5cca66872c65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:44.180162 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e33b9-e801-4e0f-8772-5cca66872c65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:44.181737 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9e33b9-e801-4e0f-8772-5cca66872c65 admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:44.191689 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1460/2900] 10.222.0.72 () {58 vars in 1122 bytes} [Thu Aug 25 03:11:44 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 25 03:11:44.195674 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:44.205866 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58050a6-aa8f-41e7-89a8-44937530e43e admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:44.210815 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:44.211563 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] REQUEST_METHOD: `PUT` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:44.211850 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:44.212161 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] PATH_INFO: `/v3/projects/c961093916ac4644826f8949b1ef8045/users/7e2af3071c2a4046a9d17d4623497006/roles/bf081564133f4648af5314a7102589fb` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:44.227479 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=c961093916ac4644826f8949b1ef8045, user_id=7e2af3071c2a4046a9d17d4623497006, role_id=bf081564133f4648af5314a7102589fb)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:44.230173 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:44.244614 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1441/2901] 10.222.0.72 () {60 vars in 1483 bytes} [Thu Aug 25 03:11:44 2022] PUT /identity/v3/projects/c961093916ac4644826f8949b1ef8045/users/7e2af3071c2a4046a9d17d4623497006/roles/bf081564133f4648af5314a7102589fb => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:44.256393 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] REQUEST_METHOD: `POST` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:44.256697 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:44.256968 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:44.285651 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.auth.core [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] MFA Rules not processed for user `7e2af3071c2a4046a9d17d4623497006`. Rule list: `[]` (Enabled: `True`). {{(pid=81633) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:44.286892 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:44.349037 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1461/2902] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:44 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 25 03:11:44.361190 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:44.363544 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:44.421652 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa876f1-ea6c-4b5d-9de4-7aa8ea0b8ded admin admin] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:44.425408 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8525dbe8-2e88-4bb8-a3c9-eb692aaab0a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '07c8b4d86a684c31b3bdf12e1245ac2d', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:44.426020 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525dbe8-2e88-4bb8-a3c9-eb692aaab0a9 service cinder] REQUEST_METHOD: `GET` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:44.426279 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525dbe8-2e88-4bb8-a3c9-eb692aaab0a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:44.426548 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8525dbe8-2e88-4bb8-a3c9-eb692aaab0a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:44.434748 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525dbe8-2e88-4bb8-a3c9-eb692aaab0a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:44.436328 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8525dbe8-2e88-4bb8-a3c9-eb692aaab0a9 service cinder] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:44.445136 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1442/2903] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:44 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:54.345582 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=70,keystone:INSERT=3 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:54.441271 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=37,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:11:55.833365 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:55.895401 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d407cc-0573-496f-8b81-ca0c6c12d1d6 None None] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:55.900170 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:55.900801 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:55.901109 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:55.901379 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] PATH_INFO: `/v3/users/7e2af3071c2a4046a9d17d4623497006` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:55.902514 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e2af3071c2a4046a9d17d4623497006)` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:55.904510 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:55.951461 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e2af3071c2a4046a9d17d4623497006'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:55.952187 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e2af3071c2a4046a9d17d4623497006'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:55.959581 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e2af3071c2a4046a9d17d4623497006'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:55.966832 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e2af3071c2a4046a9d17d4623497006'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:55.978904 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.notifications [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e2af3071c2a4046a9d17d4623497006'} {{(pid=81633) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:55.984734 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1462/2904] 10.222.0.72 () {58 vars in 1224 bytes} [Thu Aug 25 03:11:55 2022] DELETE /identity/v3/users/7e2af3071c2a4046a9d17d4623497006 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:11:55.989921 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] REQUEST_METHOD: `POST` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:55.990403 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:55.990502 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:56.010987 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.auth.core [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] MFA Rules not processed for user `188b360683ba4b74b4dc35f5cde2b951`. Rule list: `[]` (Enabled: `True`). {{(pid=81632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 25 03:11:56.012216 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:56.072865 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1443/2905] 10.222.0.72 () {58 vars in 958 bytes} [Thu Aug 25 03:11:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 25 03:11:56.083335 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:56.084800 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:56.140806 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd054408-dc2b-47d5-aeac-2e2fd7a6efdc admin admin] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:56.145030 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '084559c0a60c45bbad27051a12a4f3a3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:56.145611 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:56.145887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:56.146154 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:56.154934 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:56.156404 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:56.165764 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1463/2906] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:11:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:11:56.693343 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] Authenticating user token {{(pid=81632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:11:56.694916 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.fernet_utils [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:11:56.708147 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239c1ca6-d163-417e-ab1f-1b6bfc754f62 None None] Validating token access rules against request {{(pid=81632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:11:56.712746 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '188b360683ba4b74b4dc35f5cde2b951', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '35c83d4ef30f4517a1cc1f145e8660eb', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:11:56.713379 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:11:56.713663 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:11:56.713929 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] PATH_INFO: `/v3/projects/c961093916ac4644826f8949b1ef8045` {{(pid=81632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:11:56.715025 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c961093916ac4644826f8949b1ef8045)` {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:11:56.716945 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] RBAC: Authorization granted {{(pid=81632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:11:56.765197 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c961093916ac4644826f8949b1ef8045', 'request_id': 'req-af545350-eaf4-4cd5-9762-e757e3aeede2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:56.773324 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c961093916ac4644826f8949b1ef8045', 'request_id': 'req-af545350-eaf4-4cd5-9762-e757e3aeede2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:56.779532 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c961093916ac4644826f8949b1ef8045', 'request_id': 'req-af545350-eaf4-4cd5-9762-e757e3aeede2'} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:56.792670 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] The token cache is being invalidate because project c961093916ac4644826f8949b1ef8045 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 25 03:11:56.792960 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:56.793605 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG keystone.notifications [None req-af545350-eaf4-4cd5-9762-e757e3aeede2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 25 03:11:56.795120 dv-cinder-779578-6-smb devstack@keystone.service[81632]: [pid: 81632|app: 0|req: 1444/2907] 10.222.0.72 () {58 vars in 1233 bytes} [Thu Aug 25 03:11:56 2022] DELETE /identity/v3/projects/c961093916ac4644826f8949b1ef8045 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 25 03:12:06.161612 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:12:06.789584 dv-cinder-779578-6-smb devstack@keystone.service[81632]: DEBUG dbcounter [-] [81632] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 25 03:14:41.511192 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] Authenticating user token {{(pid=81633) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 25 03:14:41.512608 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:14:41.581334 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e5eea42-1dd1-415f-ba09-f00796294210 service neutron] Validating token access rules against request {{(pid=81633) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 25 03:14:41.638887 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '526b8be76d1c4c1fbcc1c3ae97c5ead4', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95ee65feb1754bef9a8c68f8c91bea7d', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81633) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 25 03:14:41.639493 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] REQUEST_METHOD: `GET` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 25 03:14:41.639770 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] SCRIPT_NAME: `/identity` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 25 03:14:41.640025 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81633) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 25 03:14:41.641748 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.fernet_utils [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81633) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 25 03:14:41.653299 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 25 03:14:41.654883 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f3152e-6deb-4c06-9759-43c961c128eb service placement] RBAC: Authorization granted {{(pid=81633) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 25 03:14:41.665796 dv-cinder-779578-6-smb devstack@keystone.service[81633]: [pid: 81633|app: 0|req: 1464/2908] 10.222.0.72 () {60 vars in 1365 bytes} [Thu Aug 25 03:14:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 25 03:14:51.661084 dv-cinder-779578-6-smb devstack@keystone.service[81633]: DEBUG dbcounter [-] [81633] Writing DB stats keystone:SELECT=58 {{(pid=81633) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}